Electronic apparatus, method for controlling electronic apparatus, and control program for setting image-capture conditions of image sensor

ABSTRACT

To check image changes corresponding to changes made to image-capture conditions by causing display unit to display multiple images captured under different image-capture conditions. Digital camera includes: image-capture unit having multiple first image sensors and multiple second image sensors disposed therein, first image sensors configured to capture image under first image-capture conditions, second image sensors configured to capture image under second image-capture conditions different from first image-capture conditions, image-capture unit configured to output first image data generated based on subject image which entered first image sensors and second image data generated based on subject image which entered second image sensors; and control unit configured to display first image based on first image data and second image based on second image data on display unit in such manner that selection can be made between respective recording forms of first image data and second image data.

This application is a continuation of U.S. application Ser. No.15/873,291 filed Jan. 17, 2018, which is a continuation of U.S.application Ser. No. 14/760,896 filed Jul. 14, 2015, which is a NationalStage of International Patent Application No. PCT/JP2013/076507 filed onSep. 30, 2013. The entire contents of the above applications areincorporated herein by reference.

TECHNICAL FIELD

The present invention relates to an electronic apparatus, a method forcontrolling an electronic apparatus, and a control program.

BACKGROUND ART

Electronic apparatuses each including an image sensor in which aback-illuminated image-capture chip and a signal processing chip arestacked (hereafter referred to as a stacked image sensor) have beenproposed (for example, see Patent Literature 1). In a stacked imagesensor, a back-illuminated image-capture chip and a signal processingchip are stacked so as to be connected via micro-bumps corresponding toblocks each including multiple pixels.

PRIOR ART LITERATURE Patent Literature

-   [Patent Literature 1] Japanese Unexamined Patent

Application Publication No. 2006-49361

SUMMARY OF INVENTION Technical Problem

However, there have been proposed only a few electronic apparatusesincluding a stacked image sensor configured to capture an image on amultiple-block basis. Accordingly, the usability of electronicapparatuses including a stacked image sensor has not been sufficientlyimproved.

An object of an aspect of the present invention is to check changes inimages corresponding to changes made to image-capture conditions bycausing a display unit to display multiple images captured underdifferent image-capture conditions.

Solution to Problem

A first aspect of the present invention provides an electronicapparatus. The electronic apparatus includes: an image-capture unithaving multiple first image sensors and multiple second image sensorsdisposed therein, the first image sensors being configured to capture animage under first image-capture conditions, the second image sensorsbeing configured to capture an image under second image-captureconditions different from the first image-capture conditions, theimage-capture unit being configured to output first image data generatedbased on a subject image which has entered the first image sensors andsecond image data generated based on a subject image that has enteredthe second image sensors; and a control unit configured to display afirst image based on the first image data and a second image based onthe second image data on a display unit in such a manner that aselection can be made between respective recording forms of the firstimage data and second image data.

A second aspect of the present invention provides a method forcontrolling an electronic apparatus. The electronic apparatus includesan image-capture unit having multiple first image sensors and multiplesecond image sensors disposed therein, the first image sensors beingconfigured to capture an image under first image-capture conditions, thesecond image sensors being configured to capture an image under secondimage-capture conditions different from the first image-captureconditions, the image-capture unit being configured to output firstimage data generated based on a subject image which has entered thefirst image sensors and second image data generated based on a subjectimage that has entered the second image sensors. The method includesdisplaying a first image based on the first image data and a secondimage based on the second image data on a display unit in such a mannerthat a selection can be made between respective recording forms of thefirst image data and second image data.

A third aspect of the present invention provides a control program forcausing a control device of an electronic apparatus to perform aprocess. The electronic apparatus includes an image-capture unit havingmultiple first image sensors and multiple second image sensors disposedtherein, the first image sensors being configured to capture an imageunder first image-capture conditions, the second image sensors beingconfigured to capture an image under second image-capture conditionsdifferent from the first image-capture conditions, the image-captureunit being configured to output first image data generated based on asubject image which has entered the first image sensors and second imagedata generated based on a subject image that has entered the secondimage sensors. The control program causes the control device to displaya first image based on the first image data and a second image based onthe second image data on a display unit in such a manner that aselection can be made between respective recording forms of the firstimage data and second image data.

Advantageous Effects of Invention

According to the aspects of the present invention, it is possible tocheck changes in images corresponding to changes made to image-captureconditions by causing a display unit to display multiple images capturedunder different image-capture conditions.

BRIEF DESCRIPTION OF DRAWINGS

FIG. 1 is a sectional view of an image sensor of the present embodiment.

FIG. 2 is a diagram showing the pixel array of an image-capture chip anda unit group.

FIG. 3 is a circuit diagram of a unit group of the image-capture chip.

FIG. 4 is a block diagram showing the functional configuration of animage sensor.

FIG. 5 is a diagram showing the arrangement pattern of blocks.

FIG. 6 is a cross-sectional view showing a schematic configuration of adigital camera which is an example of an electronic apparatus.

FIG. 7 is a block diagram showing the configuration of a digital cameraaccording to a first embodiment.

FIG. 8 is a diagram showing a display unit of the digital cameraaccording to the first embodiment.

FIG. 9 is a flowchart showing an imaging operation performed by a systemcontrol unit according to the first embodiment.

FIG. 10 is a drawing showing an example display of a display surfaceaccording to the first embodiment.

FIG. 11 is a drawing showing an example display of the display surfaceaccording to the first embodiment.

FIG. 12 is a drawing showing an example display of the display surfaceaccording to the first embodiment.

FIG. 13 is a drawing showing an example display of the display surfaceaccording to the first embodiment.

FIG. 14 is a diagram showing a display unit of a digital cameraaccording to a second embodiment.

FIG. 15 is a flowchart showing an imaging operation performed by asystem control unit according to the second embodiment.

FIG. 16 is a drawing showing an example display of a display surfaceaccording to the second embodiment.

FIG. 17 is a drawing showing an example display of the display surfaceaccording to the second embodiment.

FIG. 18 is a function block diagram showing an image processing unit anda system control unit of a digital camera according to a thirdembodiment.

FIG. 19 is a drawing showing an example of images displayed on a firstdisplay unit and a second display unit according to the thirdembodiment.

FIG. 20 is a drawing showing an example display of a display surfaceaccording to a fourth embodiment.

FIG. 21 is a drawing showing an example display of a display surface 51Dwhen an electronic zoom is performed according to a fifth embodiment.

FIG. 22 is a drawing showing an example display of a display surfaceaccording to a sixth embodiment.

FIG. 23 is a drawing showing an example display of a display surfaceaccording to a seventh embodiment.

FIG. 24 is a timing chart showing the timing of light emission of astrobe and the timing of charge accumulation according to an eighthembodiment.

FIG. 25 is a block diagram showing the configuration of an image-capturedevice and an electronic apparatus according to a ninth embodiment.

EMBODIMENTS OF THE INVENTION

Hereafter, embodiments of the present invention will be described withreference to the drawings. However, the present invention is not limitedthereto. To clarify the embodiments, the drawings may be scaled asappropriate, for example, partially enlarged or highlighted. Theembodiments will be described using a lens-interchangeable digitalcamera as an example of an electronic apparatus.

First Embodiment

FIG. 1 is a sectional view of an image sensor 100 of the presentembodiment. The image sensor 100 is disclosed in Japanese PatentApplication No. 2012-139026 previously filed by the present applicant.The image sensor 100 includes an image-capture chip 113 configured tooutput a pixel signal corresponding to incident light, a signalprocessing chip 111 configured to process the pixel signal outputtedfrom the image-capture chip 113, and a memory chip 112 configured tostore the pixel signal processed by the signal processing chip 111. Theimage-capture chip 113, signal processing chip 111, and memory chip 112are stacked. The image-capture chip 113 and signal processing chip 111are electrically connected to each other via conductive bumps 109 suchas Cu, and the signal processing chip 111 and memory chip 112 are alsoelectrically connected to each other via conductive bumps 109 such as

Cu.

As indicated by a coordinate axis shown in FIG. 1, incident light entersthe image sensor 100 mostly in a positive z-axis direction. In thepresent embodiment, the incident light entry surface of theimage-capture chip 113 is referred to as the back surface. Further, asindicated by another coordinate axis, the direction which isperpendicular to the z-axis and oriented to the left side of the drawingis referred to as a positive x-axis direction, and the direction whichis perpendicular to the z- and x-axes and oriented to the viewer isreferred to as a positive y-axis direction. In the following somedrawings, coordinate axes are shown using the coordinate axes in FIG. 1as a reference so that the orientations of such drawings are understood.

One example of the image-capture chip 113 is a back-illuminated MOSimage sensor. A PD layer 106 is disposed on the back surface of a wiringlayer 108. The PD layer 106 includes multiple photodiodes (PDs) 104disposed two-dimensionally and configured to accumulate chargecorresponding to incident light and transistors 105 disposed in a mannercorresponding to the PDs 104.

Color filters 102 are disposed over the incident light entry surface ofthe PD layer 106 with a passivation film 103 therebetween. The colorfilters 102 are each a filter which transmits a particular wavelengthrange of visible light, that is, the color filters 102 include multiplecolor filters having different transmission wavelength ranges and arearranged in a particular manner so as to correspond to the PDs 104. Thearrangement of the color filters 102 will be described later. A set of acolor filter 102, a PD 104, and a transistor 105 forms one pixel.

Microlenses 101 are disposed on the incident light entry sides of thecolor filters 102 in a manner corresponding to the respective pixels.The microlenses 101 condense incident light toward the corresponding PDs104.

The wiring layer 108 includes lines 107 configured to transmit pixelsignals from the PD layer 106 to the signal processing chip 111. Thelines 107 may be multilayered and may include passive and activeelements. Multiple bumps 109 are disposed on the front surface of thewiring layer 108 and aligned with multiple bumps 109 disposed on theopposite surface of the signal processing chip 111. The aligned bumps109 are bonded together and electrically connected together, forexample, by pressurizing the image-capture chip 113 and signalprocessing chip 111.

Similarly, multiple bumps 109 are disposed on the opposite surfaces ofthe signal processing chip 111 and memory chip 112 and aligned with eachother. The aligned bumps 109 are bonded together and electricallyconnected together, for example, by pressurizing the signal processingchip 111 and memory chip 112.

The methods for bonding the bumps 109 together include Cu bump bondingusing solid phase diffusion, as well as micro-bump bonding using soldermelting. For the bumps 109, it is only necessary to provide, forexample, one bump or so with respect to one unit group (to be discussedlater). Accordingly, the size of the bumps 109 may be larger than thepitch between the PDs 104. Further, bumps which are larger than thebumps 109 corresponding to a pixel region having the pixels arrangedtherein (a pixel region 113A shown in FIG. 2) may be additionallyprovided in peripheral regions other than the pixel region.

The signal processing chip 111 includes a through-silicon via (TSV) 110configured to connect together circuits disposed on the front and backsurfaces thereof. The TSV 110 is disposed in a peripheral region.

Alternatively, the TSV 110 may be disposed in a peripheral region of theimage-capture chip 113 or in the memory chip 112.

FIG. 2 is a diagram showing the pixel array of the image-capture chip113 and a unit group. In FIG. 2, the image-capture chip 113 is observedfrom the back side. The pixel region 113A is the pixel-arranged region(image-capture region) of the image-capture chip 113. In the pixelregion 113A, 20 million or more pixels are arranged in a matrix. In anexample shown in FIG. 2, four adjacent pixels×four adjacent pixels, thatis, 16 pixels form one unit group 131. Grid lines in FIG. 2 show aconcept that adjacent pixels are grouped into unit groups 131. Thenumber of pixels forming the unit groups 131 is not limited to thatdescribed above and may be on the order of 1000, for example, 32pixels×64 pixels, or may be 1000 or more or less than 1000.

As shown in a partial enlarged view of the pixel region 113A, one unitgroup 131 includes four so-called Bayer arrays which each includes fourpixels, that is, green pixels Gb, Gr, a blue pixel B, and a red pixel Rand which are arranged vertically and horizontally. The green pixels areeach a pixel having a green filter as a color filter 102 and receive thegreen-wavelength-band light of incident light. Similarly, the blue pixelis a pixel having a blue filter as a color filter 102 and receives theblue-wavelength-band light. The red pixel is a pixel having a red filteras a color filter 102 and receives the red-wavelength-band light.

FIG. 3 is a circuit diagram of a unit group of the image-capture chip113. In FIG. 3, a rectangle surrounded by a dotted line as arepresentative shows the circuit of one pixel. At least part of eachtransistor described below corresponds to one transistor 105 in FIG. 1.

As described above, one unit group 131 includes 16 pixels. Sixteen PDs104 included in these pixels are connected to corresponding transfertransistors 302. The gates of the transfer transistors 302 are connectedto a TX line 307 through which transfer pulses are supplied. In thepresent embodiment, the TX line 307 is shared by the 16 transfertransistors 302.

The drain of each transfer transistor 302 is connected to the source ofa corresponding reset transistor 303, and so-called floating diffusionFD (charge detection unit) therebetween is connected to the gate of acorresponding amplifier transistor 304. The drains of the resettransistors 303 are connected to a Vdd line 310 through whichpower-supply voltages are supplied. The gates of the reset transistors303 are connected to a reset line 306 through which reset pulses aresupplied. In the present embodiment, the reset line 306 is shared by the16 reset transistors 303.

The drains of the amplifier transistors 304 are connected to the Vddline 310, through which power-supply voltages are supplied. The sourcesof the amplifier transistors 304 are connected to the drains ofcorresponding select transistors 305. The gates of the selecttransistors 305 are connected to corresponding decoder lines 308 throughwhich selection pulses are supplied. In the present embodiment, thedifferent decoder lines 308 are disposed with respect to the 16 selecttransistors 305. The sources of the select transistors 305 are connectedto a shared output line 309. A load current source 311 supplies acurrent to the output line 309. That is, the output line 309 withrespect to the select transistors 305 is formed by a source follower.The load current source 311 may be disposed in any of the image-capturechip 113 and signal processing chip 111.

Described below is the flow from when the accumulation of charge startsto when pixel signals are outputted after the accumulation ends. Resetpulses are applied to the reset transistors 303 through the reset line306. Simultaneously, transfer pulses are applied to the transfertransistors 302 through the TX line 307. Thus, the potentials of the PDs104 and floating diffusion FD are reset.

When the application of the transfer pulses is released, the PDs 104convert received incident light into charge and accumulate it.Subsequently, when transfer pulses are applied again with reset pulsesnot being applied, the charge accumulated in each PD 104 is transferredto the corresponding floating diffusion FD. Thus, the potential of thefloating diffusion FD is changed from the reset potential to the signalpotential after the charge accumulation. When selection pulses areapplied to the select transistors 305 through the decoder lines 308, thevariation in the signal potential of each floating diffusion FD istransmitted to the output line 309 through the corresponding amplifiertransistor 304 and select transistor 305. Based on such a circuitoperation, the unit pixels output, to the output line 309, pixel signalscorresponding to the reset potentials and pixel signals corresponding tothe signal potentials.

In the present embodiment, as shown in FIG. 3, the reset line 306 and TXline 307 are shared by the 16 pixels forming the unit group 131. Thatis, reset pulses and transfer pulses are simultaneously applied to allthe 16 pixels. Accordingly, all the pixels forming the unit group 131start to accumulate charge at the same timing and end the chargeaccumulation at the same timing. Note that selection pulses aresequentially applied to the select transistors 305 and therefore pixelsignals corresponding to the accumulated charge are selectivelyoutputted to the output line 309. Different reset lines 306, TX lines307, and output lines 309 are disposed for the respective unit groups131.

By constructing the circuit on the basis of unit groups 131 as describedabove, the charge accumulation time can be controlled for each unitgroup 131. In other words, it is possible to cause the unit groups 131to output pixel signals based on different charge accumulation times.More specifically, by causing another unit group 131 to accumulatecharge several times and to output pixel signals each time while oneunit group 131 is caused to accumulate charge once, it is possible tocause the unit groups 131 to output moving image frames at differentframe rates.

FIG. 4 is a block diagram showing the functional configuration of theimage sensor 100. An analog multiplexer 411 sequentially selects 16 PDs104 forming one unit group 131 and causes each selected PD 104 to outputa pixel signal to an output line 309 disposed in a manner correspondingto the unit group 131. The multiplexer 411 is formed along with the PDs104 in the image-capture chip 113.

The analog pixel signals outputted through the multiplexer 411 areamplified by an amplifier 412 which is formed in the signal processingchip 111. The pixel signals amplified by the amplifier 412 are subjectedto correlated double sampling (CDS) and analog-to-digital (A/D)conversion by a signal processing circuit 413 which is formed in thesignal processing chip 111 and configured to perform CDS and A/Dconversion. Since the pixel signals are subjected to CDS by the signalprocessing circuit 413, the noise in the pixel signals is reduced. TheA/D-converted pixel signals are passed to a demultiplexer 414 and thenstored in corresponding pixel memories 415. The demultiplexer 414 andpixel memories 415 are formed in the memory chip 112.

An arithmetic circuit 416 processes the pixel signals stored in thepixel memories 415 and passes the resulting signals to a subsequentimage processing unit. The arithmetic circuit 416 may be disposed in anyof the signal processing chip 111 and memory chip 112. While theelements connected to the single unit group 131 are shown in FIG. 4,these elements are disposed for each unit group 131 in practice andoperate in parallel. Note that the arithmetic circuit 416 need notnecessarily be disposed for each unit group 131. For example, a singlearithmetic circuit 416 may sequentially refer to and process the valuesin the pixel memories 415 corresponding to the respective unit groups131.

As described above, the output lines 309 are disposed in a mannercorresponding to the respective unit groups 131. In the image sensor100, the image-capture chip 113, signal processing chip 111, and memorychip 112 are stacked. Accordingly, by using, as the output lines 309,the bumps 109 electrically connecting between the chips, the lines canbe routed without enlarging the chips in the surface direction.

Next, blocks set in the pixel region 113A (see FIG. 2) of the imagesensor 100 will be described. In the present embodiment, the pixelregion 113A of the image sensor 100 is divided into multiple blocks.Each block includes at least one unit group 131. Pixels included in therespective blocks are controlled by different control parameters. Thatis, the control parameters vary between pixel signals acquired frompixels included in one block and pixel signals acquired from pixelsincluded in another block. Examples of a control parameter include thecharge accumulation time or frequency, the frame rate, the gain, thethinning-out rate (pixel thinning-out rate), the number of rows orcolumns whose pixel signals are summed up (pixel summation count), andthe digitized bit number. The control parameters may be parameters usedin image processing following the acquisition of image signals from thepixels.

As used herein, the charge accumulation time refers to the time fromwhen the PDs 104 start to accumulate charge to when they end theaccumulation. The charge accumulation time is also called an exposuretime or shutter speed. The charge accumulation frequency refers to thefrequency with which the PDs 104 accumulate charge per unit time. Theframe rate refers to the number of frames processed (displayed orrecorded) per unit time in moving images. The frame rate is expressed inframes per second (fps). As the frame rate is increased, a subject (thatis, an object whose image is captured) moves more smoothly in movingimages.

The gain refers to the gain factor (amplification factor) of theamplifier 412. By changing the gain, the ISO sensitivity can be changed.The ISO sensitivity is a standard for photographic films developed bythe ISO and represents the level of the weakest light which aphotographic film can record. Typically, the sensitivity of imagesensors is represented by the ISO sensitivity. In this case, the abilityof the image sensor 100 to capture light is represented by an ISOsensitivity value. When the gain is increased, the ISO sensitivity isincreased as well. For example, when the gain is doubled, the electricalsignal (pixel signal) is doubled as well. Thus, appropriate brightnessis obtained even when the amount of incident light is halved. However,increasing the gain amplifies noise included in the electric signal,thereby increasing noise.

The thinning-out rate refers to the ratio of the number of pixels fromwhich pixel signals are not read to the total number of pixels in apredetermined region. For example, a thinning-out rate of apredetermined region of 0 means that pixel signals are read from allpixels in the predetermined region. A thinning-out rate of apredetermined region of 0.5 means that pixel signals are read from halfthe pixels in the predetermined region. Specifically, where a unit group131 is a Bayer array, one Bayer array unit from which pixel signals areread and one Bayer array from which pixel signals are not read arealternately set in the vertical direction, that is, two pixels (tworows) from which pixel signals are read and two pixels (two rows) fromwhich pixel signals are not read are alternately set in the verticaldirection. On the other hand, when the pixels from which pixel signalsare read are thinned out, the resolution of images is reduced. However,20 million or more pixels are arranged in the image sensor 100 andtherefore, even when the pixels are thinned out, for example, at athinning-out rate of 0.5, an image can be displayed with 10 million ormore pixels. For this reason, the user (photographer) seems not to worryabout such a resolution reduction.

The number of rows whose pixel signals are summed up refers to thenumber of vertically adjacent pixels whose pixel signals are summed up.The number of columns whose pixel signals are summed up refers to thenumber of horizontally adjacent pixels whose pixel signals are summedup. Such a summation process is performed, for example, in thearithmetic circuit 416. When the arithmetic circuit 416 sums up pixelsignals of a predetermined number of vertically or horizontally adjacentpixels, there is obtained an effect similar to that obtained by thinningout the pixels at a predetermined thinning-out rate and reading pixelsignals from the resulting pixels. In the summation process, an averagevalue may be calculated by dividing the sum of the pixel signals by therow number or column number obtained by the arithmetic circuit 416.

The digitized bit number refers to the number of bits of a digitalsignal converted from an analog signal by the signal processing circuit413. As the number of bits of a digital signal is increased, luminance,color change, or the like is represented in more detail.

In the present embodiment, the accumulation conditions refer toconditions on the accumulation of charge in the image sensor 100.Specifically, the accumulation conditions refer to the chargeaccumulation time or frequency, frame rate, and gain in the controlparameters. Since the frame rate can change according to the chargeaccumulation time or frequency, it is included in the accumulationconditions. Similarly, the correct amount of exposure can changeaccording to the gain, and the charge accumulation time or frequency canchange according to the correct amount of exposure. Accordingly, thegain is included in the accumulation conditions.

In the present embodiment, the image-capture conditions refer toconditions on image-capture of a subject. Specifically, theimage-capture conditions refer to control parameters including theaccumulation conditions. The image-capture conditions includes controlparameters for controlling the image sensor 100 (e.g., the chargeaccumulation time or frequency, frame rate, gain), as well as controlparameters for controlling reading of signals from the image sensor 100(e.g., thinning-out rate, the number of rows or columns whose pixelsignals are summed up) and control parameters for processing signalsfrom the image sensor 100 (e.g., digitized bit number, and controlparameters used when an image processing unit 30 (to be discussed later)performs image processing).

FIG. 5 is a diagram showing the arrangement pattern of blocks. In thearrangement pattern shown in FIG. 5, the pixel region 113A is dividedinto four image-capture regions (first to fourth image-capture regions).In the pixel region 113A, the first image-capture region includes blocksin odd rows (2 n−1) in columns (4 m−3), by three columns, precedingcolumns whose numbers are multiples of four and blocks in even rows (2n) in columns (4 m−1), by one column, preceding columns whose numbersare multiples of four. The second image-capture region includes blocksin odd rows (2 n−1) in columns (4 m−2), by two columns, precedingcolumns whose numbers are multiples of four and blocks in even rows (2n) in columns (4 m) whose numbers are multiples of four. The thirdimage-capture region includes blocks in odd rows (2 n−1) in columns (4m−1), by one column, preceding columns whose numbers are multiples offour and blocks in even rows (2 n) in columns (4 m−3), by three columns,preceding columns whose numbers are multiples of four. The fourthimage-capture region includes blocks in odd rows (2 n−1) in columns (4m) whose numbers are multiple of four and blocks in even rows (2 n) incolumns (4 m−2), by two columns, preceding columns whose numbers aremultiple of four. As used herein, m and n are positive integers (m=1, 2,3, . . . ; n=1, 2, 3, . . . ).

While a small number of blocks are set in the pixel region 113A in FIG.5 so that the arrangement of blocks of each image-capture region iseasily seen, blocks in a larger number than the number of blocks shownin FIG. 5 may be set in the pixel region 113A.

According to this arrangement pattern, the first to fourth image-captureregions are arranged uniformly in the pixel region (image-captureregion) 113A. Further, the first to fourth image-capture regions havethe same area. Note that the first to fourth image-capture regions onlyhave to be each arranged across the pixel region 113A. Accordingly,these image-capture regions need not necessarily be arranged uniformlyin the pixel region 113A or need not necessarily have the same area.

In the arrangement pattern shown in FIG. 5, the first to fourthimage-capture regions are disposed in different positions (that is, theimage-capture regions are displaced from one another); therefore,different subject images enter the first to fourth image-captureregions. Accordingly, images based on sets of image data generated inthe first to fourth image-capture regions are different subject images.However, the first to fourth image-capture regions are each disposedacross the pixel region 113A. Accordingly, the images based on the setsof image data generated in the first to fourth image-capture regionslook like the same subject image for the user.

In the present embodiment, image sensors (photoelectric conversionelements and associated circuits) disposed for the pixels in the firstimage-capture region are referred to as the first image sensors; imagesensors disposed for the pixels in the second image-capture region asthe second image sensors; image sensors disposed for the pixels in thethird image-capture region as the third image sensors; and image sensorsdisposed for the pixels in the fourth image-capture region as the fourthimage sensors. That is, the image sensor 100 is divided into themultiple first image sensors, multiple second image sensors, multiplethird image sensors, and multiple fourth image sensors.

In the present embodiment, the first image sensors, second imagesensors, third image sensors, and fourth image sensors capture imagesunder different image-capture conditions. Hereafter, the image-captureconditions of the first image sensors will be referred to as the firstimage-capture conditions; the image-capture conditions of the secondimage sensors as the second image-capture conditions; the image-captureconditions of the third image sensors as third image-capture conditions;and the image-capture conditions of the fourth image sensors as thefourth image-capture conditions.

FIG. 6 is a cross-sectional view showing a schematic configuration of adigital camera 1, which is an example of an electronic apparatus. Thedigital camera 1 of the present embodiment includes a lens unit 10 and acamera body 2. The lens unit 10 is an interchangeable lens. The camerabody 2 includes a body-side mounting unit 80A for mounting the lens unit10. The lens unit 10 includes a lens-side mounting unit 80Bcorresponding to the body-side mounting unit 80A. When the user joinsthe body-side mounting unit 80A and lens-side mounting unit 80Btogether, the lens unit 10 is mounted on the camera body 2. Thus, anelectrical contact 81A of the body-side mounting unit 80A and anelectrical contact 81B of the lens-side mounting unit 80B areelectrically connected together.

The lens unit 10 includes an imaging optical system 11, a diaphragm 14,and a lens drive control unit 15. The imaging optical system 11 includesa lens 11 a, a zooming lens 11 b, and a focusing lens 11 c. The lensdrive control unit 15 includes a lens-side central processing unit(CPU), a memory, and a drive control circuit. When the lens drivecontrol unit 15 is electrically connected to the system control unit 70in the camera body 2 through the electrical contacts 81A and 81B, ittransmits lens information about the optical characteristics of theimaging optical system 11 in the lens unit 10 and receives controlinformation for driving the zooming lens lib, focusing lens 11 c, anddiaphragm 14.

The lens-side CPU of the lens drive control unit 15 causes the drivecontrol circuit to control drive of the focusing lens 11 c on the basisof control information that the system control unit 70 transmits inorder to adjust the focus of the imaging optical system 11. Thelens-side CPU of the lens drive control unit 15 also causes the drivecontrol circuit to control drive of the zooming lens 11 b on the basisof control information that the system control unit 70 transmits inorder to adjust the zoom. The diaphragm 14 is disposed along the opticalaxis of the imaging optical system 11. The diaphragm 14 forms anaperture whose diameter with respect to the optical axis is variable, toadjust the amount of light and the amount of blur. The lens-side CPU ofthe lens drive control unit 15 causes the drive control circuit tocontrol drive of the diaphragm 14 on the basis of control informationthat the system control unit 70 transmits in order to adjust theaperture diameter of the diaphragm 14.

The camera body 2 includes an image-capture unit 20, an image processingunit 30, a display unit 50, a recording unit 60, and the system controlunit 70. The image-capture unit 20 includes the image sensor 100. Theimage sensor 100 receives light emitted by the imaging optical system 11of the lens unit 10. The pixels of the image sensor 100photoelectrically convert the received light into pixel signals (thesepixel signals will be included in image data). The image-capture unit 20then transmits RAW data including the pixel signals generated by thepixels (the RAW data will be also included in the image data) to theimage processing unit 30. Then, the image processing unit 30 performsvarious types of image processing on the RAW data to generate image datain a predetermined file format (e.g., JPEG). Then, the display unit 50displays the image data generated by the image processing unit 30. Therecording unit 60 stores the image data generated by the imageprocessing unit 30.

Hereafter, the “image data” may be referred to as the “image signal.”Images include still images, moving images, and live view images. Liveview images refer to images displayed on the display unit 50 based onimage data sequentially generated and outputted by the image processingunit 30. The user uses live view images to check subject images that theimage-capture unit 20 is capturing. Live view images are also calledthrough images or preview images.

The system control unit 70 controls the entire processing and operationof the digital camera 1. The processing and operation of the systemcontrol unit 70 and the internal configuration of the camera body 2 willbe described in detail with reference to FIG. 7.

FIG. 7 is a block diagram showing the configuration of the digitalcamera 1 according to the first embodiment. As shown in FIG. 7, thedigital camera 1 includes the camera body 2 and lens unit 10. Asdescribed above, the lens unit 10 is an interchangeable lens which isdetachable from the camera body 2. Accordingly, the digital camera 1does not need to include the lens unit 10. Note that the lens unit 10may be integral with the digital camera 1. In a state in which the lensunit 10 is connected to the camera body 2, it guides light from asubject to the image-capture unit 20.

As described above, the lens unit 10 includes the lens drive controlunit 15 (see FIG. 6). The lens unit 10 also includes the imaging opticalsystem 11, that is, the lens 11 a, zooming lens 11 b, and focusing lens11 c. When the lens unit 10 is coupled to the camera body 2, the lensdrive control unit 15 transmits lens information stored in the memory tothe system control unit 70 of the camera body 2 and receives controlinformation from the system control unit 70. The lens drive control unit15 then controls the drive of the zooming lens 11 b, focusing lens 11 c,and diaphragm 14 on the basis of the control information.

As shown in FIG. 7, the camera body 2 includes the image-capture unit20, the image processing unit 30, a work memory 40, the display unit 50,an operation unit 55, the recording unit 60, the system control unit 70,and a strobe 90.

The image-capture unit 20 includes the image sensor 100 and a drive unit21. The drive unit 21 is a control circuit configured to control thedrive of the image sensor 100 in accordance with an instruction from thesystem control unit 70. Specifically, the drive unit 21 controls thecharge accumulation time or frequency, which is a control parameter, bycontrolling the timing (or the cycle of the timing) when reset pulses ortransfer pulses are applied to the reset transistors 303 or transfertransistors 302, respectively. The drive unit 21 also controls the framerate by controlling the timing (or the cycle of timing) when resetpulses, transfer pulses, or selection pulses are applied to the resettransistors 303, transfer transistor 302, or select transistors 305,respectively. The drive unit 21 also controls the thinning-out rate bysetting pixels to which reset pulses, transfer pulses, and selectionpulses are applied.

The drive unit 21 also controls the ISO sensitivity of the image sensor100 by controlling the gain (also called the gain factor oramplification factor) of the amplifier 412. The drive unit 21 also setsthe number of rows or columns whose pixel signals are summed up bysending an instruction to the arithmetic circuit 416. The drive unitalso sets the digitized bit number by sending an instruction to thesignal processing circuit 413. The drive unit 21 also sets a region inunits of blocks in the pixel region (image-capture region) 113A of theimage sensor 100. As seen above, the drive unit 21 serves as an imagesensor control unit that causes the image sensor 100 to capture an imageunder image-capture conditions which vary among the groups of multipleblocks and then to output pixel signals. The system control unit 70sends an instruction about the positions, shapes, ranges, or the like ofthe blocks to the drive unit 21.

The image sensor 100 passes the pixel signals from the image sensor 100to the image processing unit 30. The image processing unit 30 thenperforms various types of image processing on the RAW data including thepixel signals using the work memory 40 as work space to generate imagedata in a predetermined file format (e.g., JPEG). For example, the imageprocessing unit 30 performs color signal processing (color tonecorrection) on the signals obtained from the Bayer arrays to generateRGB image signals. The image processing unit 30 then performs imageprocessing such as white balance adjustment, sharpness adjustment, gammacorrection, gradation adjustment, or the like on the RGB image signals.The image processing unit 30 also compresses the resulting signals in apredetermined compression format (JPEG format, MPEG format, or thelike), if necessary. The image processing unit 30 then outputs theresulting image data to the recording unit 60. The image processing unit30 also outputs the image data to the display unit 50.

Parameters referred to when the image processing unit performs imageprocessing are also included in the control parameters (image-captureconditions). For example, parameters such as color signal processing(color tone correction), white balance adjustment, gradation adjustment,and compression rate are included in the control parameters. Signalsread from the image sensor 100 change according to the chargeaccumulation time or the like, and the parameters referred to in imageprocessing also change according to the changes in the signals. Theimage processing unit 30 sets different control parameters with respectto the respective blocks and performs image processing such as colorsignal processing on the basis of these control parameters.

The image processing unit 30 also extracts frames corresponding topredetermined timings from multiple frames chronologically obtained fromthe image-capture unit 20. The image processing unit 30 also discardsframes corresponding to predetermined timings from multiple frameschronologically obtained from the image-capture unit 20. Thus, it ispossible to reduce the amount of data to reduce the load on subsequentprocesses. The image processing unit also calculates one or more framesto be interpolated between multiple frames chronologically obtained fromthe imaging unit 20 and then interpolates the calculated one or moreframes between the multiple frames. Thus, it is possible to reproducemoving images in such a manner that the images move more smoothly. Whilethe drive unit 21 is configured to control the thinning-out rate, otherconfigurations may be employed. For example, the image processing unit30 or arithmetic circuit 416 may control the thinning-out rate bydiscarding predetermined pixel signals of pixel signals read from allthe pixels by the drive unit 21.

In the present embodiment, as shown in FIG. 7, the image processing unit30 includes an image generation unit 31. The image generation unit 31generates image data by performing various types of image processing onthe RAW data including the pixel signals outputted from theimage-capture unit 20. The image generation unit 31 generates firstimage data on the basis of RAW data including image signals from thefirst image-capture region, second image data on the basis of RAW dataincluding image signals from the second image-capture region, thirdimage data on the basis of RAW data including image signals from thethird image-capture region, and fourth image data on the basis of RAWdata including image signals from the fourth image-capture region.

The work memory 40 temporarily stores image data or the like while theimage processing unit 30 performs image processing. The display unit 50displays images (still images, moving images, live view images) capturedby the image-capture unit 20 or various types of information. Thedisplay unit 50 includes a display surface (display panel) 51 such as aliquid crystal display panel. A touchscreen (selection unit) 52 isformed on the display surface 51 of the display unit 50. When the usertouches the touchscreen 52 to perform an operation such as a selectionof a menu, the touchscreen 52 outputs a signal indicating the touchedposition to the system control unit 70.

The operation unit 55 includes a release switch operated by the user (aswitch pressed to acquire a still image), a moving image switch (aswitch pressed to acquire images of a motion), and other operationswitches. The operation unit 55 outputs a signal corresponding to anoperation of the user to the system control unit 70. The recording unit60 has a card slot into which a storage medium such as a memory card canbe inserted. The recording unit 60 stores, in a storage medium insertedin the card slot, image data generated by the image processing unit 30or various types of data. The recording unit 60 also includes aninternal memory. The recording unit 60 can also record, in the internalmemory, image data generated by the image processing unit 30 or varioustypes of data.

The system control unit 70 controls the entire processing and operationof the digital camera 1. The system control unit 70 includes a body-sidecentral processing unit (CPU). In the present embodiment, the systemcontrol unit 70 divides the image-capture surface (pixel region 113A) ofthe image sensor 100 (image-capture chip 113) into multiple blocks andcauses the image sensor 100 to capture an image with charge accumulationtimes (or charge accumulation frequencies), frame rates, and gains whichvary among the blocks. To this end, the system control unit 70 transmitsthe positions, shapes, and ranges of the blocks and the accumulationconditions for the blocks to the drive unit 21.

The system control unit 70 also causes the image sensor 100 to capturean image at thinning-out rates, the numbers of rows or columns whosepixel signals are summed up, and digitized bit numbers which vary amongthe blocks. To this end, the system control unit 70 transmits theimage-capture conditions (thinning-out rates, the numbers of rows orcolumns whose pixel signals are summed up, and digitized bit numbers)for the blocks to the drive unit 21. The image processing unit 30 alsoperforms image processing under image-capture conditions (controlparameters such as color signal processing, white balance adjustment,gradation adjustment, and compression rate) which vary among the blocks.To this end, the image processing unit 70 transmits the image-captureconditions (control parameters such as color signal processing, whitebalance adjustment, gradation adjustment, and compression rate) for theblocks to the image processing unit 30.

The system control unit 70 causes the recording unit 60 to record imagedata generated by the image processing unit 30. The system control unit70 also causes the image processing unit 30 to output the generatedimage data to the display unit 50 so that an image is displayed on thedisplay unit 50. The system control unit 70 also causes the storage unit60 to output the recorded image data to the display unit 50 so that animage is displayed on the display unit 50. Images displayed on thedisplay unit 50 include still images, moving images, and live viewimages.

The system control unit 70 also outputs control information to the lensdrive control unit 15 to cause the lens drive control unit 15 to controlthe drive of the focusing lens 11 c and diaphragm 14. The system controlunit is implemented when the body-side CPU performs processing on thebasis of a control program.

In the present embodiment, as shown in FIG. 7, the system control unit70 includes a control unit 71, a selection unit 72, a setting unit 73,and a division unit 74. The control unit 71 causes the image generationunit 31 to output generated image data to the display unit 50 so that animage is displayed on the display surface 51 of the display unit 50. Thecontrol unit 71 also causes the display surface 51 of the display unit50 to display a preset menu image (see FIG. 8).

The selection unit 72 selects one of the four display regions (firstdisplay region 511, second display region 512, third display region 513,and fourth display region 514) in response to a touch on the touchscreen52 by the user. The setting unit 73 sets image-capture conditions(including accumulation conditions) in response to a touch on thetouchscreen 52 by the user, or automatically. The setting unit 73 mayset the same image-capture conditions for the entire pixel region 113Aof the image sensor 100. The setting unit 73 may also set differentimage-capture conditions for the respective image-capture regions (firstto fourth image-capture regions) shown in FIG. 5. The setting unit 73also causes the image sensor 100 to capture an image under predeterminedimage-capture conditions or image-capture conditions changed in responseto an operation of the user. The division unit 74 divides the pixelregion 113A of the image sensor 100 into the first to fourthimage-capture regions as shown in FIG. 5.

The strobe 90 is a device configured to emit light (a flash of light) inorder to image. The strobe 90 emits light in a predetermined amount onthe basis of an instruction signal from the system control unit 70.

FIG. 8 is a diagram showing the display unit 50 of the digital camera 1according to the present embodiment. As shown in FIG. 8, the displayunit 50 has the display surface 51. The display surface 51 has the imagedisplay region 510 and an operation button display region 520. The imagedisplay region 510 is a region for displaying images based on image datagenerated by the image-capture unit 20. Examples of images displayed onthe image display region 510 include still images, moving images, andlive view images. The operation button display region 520 is a regionfor displaying a menu image 520M for the user to set image-captureconditions or the like. The image display region 510 and operationbutton display region 520 are disposed on the single display surface 51.

The image display region 510 is divided into multiple display regions sothat multiple images can be displayed. For example, the image displayregion 510 is divided into four display regions so that images based onfour sets of image data generated by the image-capture unit 20 aredisplayed. Of the four display regions, the upper-left display region isreferred to as a first display region 511; the upper-right displayregion as a second display region 512; the lower-left display region asa third display region 513; and the lower-right display region as afourth display region 514.

In the example shown in FIG. 8, the first display region 511, seconddisplay region 512, third display region 513, and fourth display region514 have the same area. These display regions may have different areas.For example, the first display region may have a larger area than thesecond display region, third display region, or fourth display region;the second display region may have a larger area than the first displayregion, third display region, or fourth display region; the thirddisplay region may have a larger area than the first display region,second display region, or fourth display region; or the fourth displayregion may have a larger area than the first display region, seconddisplay region, or third display region.

The first display region 511 is a region for displaying an image basedon image data generated in the first image-capture region shown in FIG.5 (hereafter referred to as the first image); the second display region512 is a region for displaying an image based on image data generated inthe second image-capture region shown in FIG. 5 (hereafter referred toas the second image); the third display region 513 is a region fordisplaying an image based on image data generated in the thirdimage-capture region shown in FIG. 5 (hereafter referred to as the thirdimage); and the fourth display region 514 is a region for displaying animage based on image data generated in the fourth image-capture regionshown in FIG. 5 (hereafter referred to as the fourth image). Asdescribed above, the first to fourth image-capture regions shown in FIG.5 are uniformly disposed in the entire pixel region 113A; therefore, thefirst to fourth images all look like the same subject image. However, asdescribed above, images are captured under different image-captureconditions in the first to fourth image-capture regions shown in FIG. 5.Accordingly, the brightness of the subject, blurring of the subject,smoothness of a movement of the subject in moving images, and the likevary among the image-capture conditions.

Examples of the first image include first live view images, first stillimages, and first moving images; examples of the second image includesecond live view images, second still images, and second moving images;example of the third image include third live view images, third stillimages, and third moving images; and examples of the fourth imageinclude fourth live view images, fourth still image, and fourth movingimages.

The display unit 50 includes the touchscreen 52. The touchscreen 52 isdisposed on the display surface 51. The touchscreen 52 is formed in sucha manner that a first touch region 511 a overlaps the first displayregion 511; a second touch region 512 a overlaps the second displayregion 512; a third touch region 513 a overlaps the third display region513; and a fourth touch region 514 a overlaps the fourth display region514. When the user presses any of the first touch region 511 a, secondtouch region 512 a, third touch region 513 a, and fourth touch region514 a, the touch region detects that it has been pressed (touched) andoutputs a detection signal indicating the pressed position (the pressedtouch region) to the system control unit 70.

The operation button display region 520 is disposed near the imagedisplay region 510. Displayed in the operation button display region 520is the menu image 520M for the user to select a display region or setimage-capture conditions, imaging mode, or the like. The menu image 520Mincludes a selection button image 521, an ISO sensitivity button image522, a shutter speed button image 523, a picture control button image524, and an imaging mode button image 525. The selection button image521 is an image for the user to select one of the first to fourth imagesdisplayed on the first to fourth display regions, respectively. The ISOsensitivity button image 522 is an image for the user to set the ISOsensitivity (i.e., gain). The shutter speed button image 523 is an imagefor the user to set the shutter speed (i.e., exposure time). The shutterspeed corresponds to the charge accumulation time. The picture controlbutton image 524 is an image for the user to set (adjust) imageproperties such as image tone, hue, or contrast. The imaging mode buttonimage 525 is an image for the user to make a selection as to whether toset image-capture conditions manually or automatically.

The touchscreen 52 is formed in such a manner that a touch region 521 aoverlaps the selection button image 521; a touch region 522 a overlapsthe ISO sensitivity button image 522; a touch region 523 a overlaps theshutter speed button image 523; a touch region 524 a overlaps thepicture control button image 524; and a touch region 525 a overlaps theimaging mode button image 525. When the user presses any of the touchregion 521 a, touch region 521 a, touch region 521 a, and touch region525 a, the touch region detects that it has been pressed (touched) andoutputs a detection signal indicating the pressed position (the pressedtouch region) to the system control unit 70.

Next, a still image acquisition operation of the digital camera 1according to the first embodiment will be described. FIG. 9 is aflowchart showing an imaging operation performed by the system controlunit 70 according to the first embodiment. FIGS. 10 to 13 are drawingseach showing an example display of the display surface 51 according tothe first embodiment.

In the process shown in FIG. 9, the user powers on the digital camera 1and then operates the operation unit 55 or the like to start imaging andthus the division unit 74 divides the pixel region 113A of the imagesensor 100 into multiple image-capture regions (first to fourthimage-capture regions) as shown in FIG. 5 and sets these image-captureregions. Then, the setting unit 73 sets predetermined standardimage-capture conditions for the first to fourth image-capture regionsset by the division unit 74 (step S1). For example, the setting unit 73sets an ISO sensitivity of “100,” a shutter speed of “½ s,” and the likeas standard image-capture conditions for the first image-capture region.The setting unit 73 also sets an ISO sensitivity of “200,” a shutterspeed of “ 1/100 s,” and the like as standard image-capture conditionsfor the second image-capture region. The setting unit 73 also sets anISO sensitivity of “400,” a shutter speed of “ 1/500 s,” and the like asstandard image-capture conditions for the third image-capture region.The setting unit 73 also sets an ISO sensitivity of “800,” a shutterspeed of “ 1/1000 s,” and the like as standard image-capture conditionsfor the fourth image-capture region.

Then, the system control unit 70 starts an imaging operation (step S2).The control unit 71 displays, in the first display region 511 of thedisplay surface 51, a first live view image based on first image datagenerated in the first image-capture region of the image sensor 100. Thecontrol unit 71 also displays, in the second display region 512 of thedisplay surface 51, a second live view image based on second image datagenerated in the second image-capture region of the image sensor 100.The control unit 71 also displays, in the third display region 513 ofthe display surface 51, a third live view image based on third imagedata generated in the third image-capture region of the image sensor100. The control unit 71 also displays, in the fourth display region 514of the display surface 51, a fourth live view image based on fourthimage data generated in the fourth image-capture region of the imagesensor 100 (step S3). In the example shown in FIG. 10, first to fourthlive view images of a waterfall are displayed on the first displayregion 511, second display region 512, third display region 513, andfourth display region 514, respectively. Since images are captured underdifferent image-capture conditions in the first to fourth image-captureregions, the live view images displayed in the first display region 511,second display region 512, third display region 513, and fourth displayregion 514 vary in the brightness, blurring, contrast, or the like ofthe subject (moving subject).

The user can check the differences among the images based on thedifferences among the image-capture conditions by making comparisonamong the first to fourth live view images displayed on the firstdisplay region 511, second display region 512, third display region 513,and fourth display region 514 of the image display region 510. The userthen touches the selection button image 521 (i.e., touch region 521 a)in order to select one of the first to fourth live view images. Thus,the display regions are allowed to be selected, that is, the four touchregions (first touch region 511 a, second touch region 512 a, thirdtouch region 513 a, and fourth touch region 514 a) of the touchscreen 52are allowed to detect a touch. The user then touches one of the fourdisplay regions (first display region 511, second display region 512,third display region 513, and fourth display region 514) to select thetouched display region. The touchscreen 52 then outputs, to the systemcontrol unit 70, a detection signal corresponding to the touch regiontouched by the user.

The selection unit 72 identifies the display region selected by the useron the basis of the detection signal from the touchscreen 52. In theexamples shown in FIGS. 11 to 13, the first display region 511 isselected by the user. The selection unit 72 then determines whether anyof the first display region 511, second display region 512, thirddisplay region 513, and fourth display region 514 has been selected bythe user (step S4). If so, the selection unit 72 sets the display region(the first display region 511 in FIG. 11) selected by the user (stepS5).

Specifically, the selection unit 72 outputs, to the drive unit 21, asignal indicating the positions or the like of blocks corresponding tothe display region selected by the user.

The user can make a change to any of the image-capture conditions of theselected display region (i.e., one of the first to fourth image-captureregions). The setting unit 72 determines whether the user has made achange to any image-capture region (step S6). If so, the selection unit72 sets the changed image-capture condition (step S7).

For example, if the user wishes to set an ISO sensitivity as animage-capture condition for the first display region 511, he or shetouches the ISO sensitivity button image 522 (i.e., touch region 522 a).The touchscreen 52 then outputs, to the system control unit 70, adetection signal corresponding to the touch region 522 a touched by theuser. As shown in FIG. 11, the control unit 71 displays multiple ISOsensitivity values on a side of the ISO sensitivity button image 522. Inthe example shown in FIG. 11, “100,” “200,” “400,” “800,” and “1600” aredisplayed as ISO sensitivity values. At this time, the setting unit 73sets new touch regions on the touchscreen 52 in such a manner that thenew touch regions overlap the ISO sensitivity values. The user thentouches one of the ISO sensitivity values. The touchscreen 52 thenoutputs, to the system control unit 70, a detection signal correspondingto the touch region touched by the user. The setting unit 73 then setsthe ISO sensitivity value touched by the user. Specifically, the settingunit 73 outputs, to the drive unit 21, a signal indicating a gaincorresponding to the ISO sensitivity value selected by the user.

If the user wishes to set a shutter speed (charge accumulation time) asan image-capture condition for the first display region 511, he or sheperforms an operation similar to setting of the ISO sensitivity. Thatis, if the user wishes to set a shutter speed as an image-capturecondition, he or she touches the shutter speed button image 523 (i.e.,touch region 523 a). The touchscreen 52 then outputs, to the systemcontrol unit 70, a detection signal corresponding to the touch region523 a touched by the user. The control unit 71 then displays multipleshutter speed values on a side of the shutter speed button image 523.The user then touches one of the shutter speed values. The setting unit73 then sets the shutter speed value touched by the user. Specifically,the setting unit 73 outputs, to the drive unit 21, a signal indicatingthe shutter speed selected by the user.

If the user wishes to set picture control as an image-capture conditionfor the first display region 511, he or she touches the picture controlbutton image 524 (i.e., touch region 524 a). The touchscreen 52 thenoutputs, to the system control unit 70, a detection signal correspondingto the touch region 524 a touched by the user. As shown in FIG. 12, thecontrol unit 71 displays multiple picture control types on a side of thepicture control button image 524. In the example shown in FIG. 12,“standard,” “neutral,” “landscape,” and “vivid” are displayed as picturecontrol types. As used herein, “standard” refers to a picture controltype in which the image processing unit 30 adjusts the image to astandard image which is not unbalanced in the edge strength, contrast,brightness, color depth, or the like of the subject; “neutral” refers toa picture control type in which the image processing unit 30 adjusts theimage to an image in which gradation or hue specific to the subject isfaithfully reproduced and which is closest to the real subject;“landscape” refers to a picture control type in which the imageprocessing unit 30 adjusts a natural landscape, a streetscape, or thelike to a stereoscopic image with high gradation; and “vivid” refers toa picture control type in which the image processing unit 30 adjusts theimage to a vivid image in which the edge or contrast of the subject isenhanced.

At this time, the setting unit 73 sets new touch regions in thetouchscreen 52 in such a manner that the new touch regions overlap thepicture control types. The user then touches one of the picture controltypes. The touchscreen 52 then outputs, to the system control unit 70, adetection signal corresponding to the touch region touched by the user.The setting unit 73 then sets the picture control type touched by theuser. Specifically, the setting unit 73 outputs, to the image processingunit 30, a signal indicating the picture control type selected by theuser.

If the user wishes to set an imaging mode as an image-capture conditionfor the first display region 511, he or she touches the imaging modebutton image 525 (i.e., touch region 525 a). The touchscreen 52 thenoutputs, to the system control unit 70, a detection signal correspondingto the touch region 525 a touched by the user. As shown in FIG. 13, thecontrol unit 71 displays “P,” “S,” “A,” and “M” on a side of the imagingmode button image 525. “P” represents P mode (program auto), in whichthe aperture value and shutter speed are automatically determined sothat correct exposure is obtained; “S” represents S mode (shutterpriority mode), in which an aperture value with respect to a shutterspeed selected by the user is determined such that correct exposure isobtained; “A” represents A mode (aperture priority mode), in which ashutter speed with respect to an aperture value selected by the user isdetermined automatically such that correct exposure is obtained; and “M”represents M mode (manual mode), in which the user selects both anaperture value and a shutter speed. Note that while the system controlunit 70 (setting unit 73) can set different image-capture conditions forthe respective blocks of the pixel region 113A as described above, itcannot set an aperture value for each block and therefore sets anaperture value for the entire image-capture region 113A.

At this time, the setting unit 73 sets new touch regions in thetouchscreen 52 in such a manner that the new touch regions overlap theimaging modes. The user then touches one of the imaging modes. Thetouchscreen 52 then outputs, to the system control unit 70, a detectionsignal corresponding to the touch region touched by the user. Thesetting unit 73 then sets the imaging mode touched by the user. If oneof “P,” “S,” “A” is selected, the setting unit automatically determinesat least one of the aperture value and shutter speed so that correctexposure is obtained. If the setting unit 73 determines the shutterspeed, it outputs a signal indicating the shutter speed to the driveunit 21. If the setting unit 73 determines the aperture value, itoutputs, to the lens drive control unit 15, control informationcorresponding to the aperture value.

The drive unit 21 receives the signal indicating, in units of blocks,the first image-capture region corresponding to the first display region511 selected by the user. The drive unit 21 also receives the signalindicating the image-capture conditions selected by the user. The driveunit 21 then drives the image-capture unit so that the image-captureunit 20 captures an image under the indicated image-capture conditions(shutter speed, ISO sensitivity) in the blocks corresponding to thefirst display region 511. The image processing unit 30 receives thesignal indicating the image-capture conditions selected by the user. Theimage processing unit 30 then performs image processing on RAW data fromthe first image-capture region under the indicated image-captureconditions (control parameters such as white balance, gradation, andcolor tone correction). The lens drive control unit 15 adjusts theaperture diameter of the diaphragm 14 on the basis of the controlinformation from the system control unit 70.

By changing the image-capture conditions of the first image-captureregion as described above, changes occur in the first live view imagedisplayed in the first display region 511. For example, by increasingthe ISO sensitivity, a bright image of the subject is captured even witha small amount of light. Further, dark portions of the first live viewimage are brightened. By increasing the shutter speed, blurring of themoving subject is reduced.

As seen above, if the user selects one of the first display region 511,second display region 512, third display region 513, and fourth displayregion 514 and then sets image-capture conditions for the selecteddisplay region, he or she can check changes in the live view imagecorresponding to the changes made to the image-capture conditions. Inthis case, the image-capture conditions selected by the user may not beconditions suitable for correct exposure. However, the user canrecognize that the changes made to the image-capture conditions mayresult in overexposure or underexposure. Further, the user canunderstand how the image changes due to changes made to anyimage-capture condition. As seen above, the user can make changes to theimage-capture conditions and then check multiple live view images beforecapturing an image.

Steps S1 to S7 described above are repeated until the user presses therelease switch of the operation unit 55 halfway (step S8). While thecase where the user selects the first display region 511 of the fourdisplay regions has been described with reference to FIGS. 10 to 13, asimilar process is performed when the user selects the second displayregion 512, third display region 513, or fourth display region 514.

Although not shown in FIGS. 10 to 13, the user may set image-captureconditions other than the ISO sensitivity, shutter speed, and picturecontrol for each region. For example, the user may set the frame rate,thinning-out rate, the number of rows or columns whose pixel signals aresummed up, the digitized bit number, and the like as image-captureconditions for each display region. The user may also set parameterssuch as color signal processing, white balance adjustment, gradationadjustment, and compression rate as image-capture conditions for eachdisplay region.

Subsequently, the system control unit 70 determines whether the releaseswitch has been pressed halfway (SW1 operation) (step S8). A halfwaypress is used as an instruction for causing the system control unit 70to start preparation for capturing an image. Although not shown in FIG.8, the system control unit 70 also performs steps such as control ofauto focus (AF), where the focus is adjusted automatically.

The system control unit 70 then determines whether the release switchhas been pressed all the way (SW2 operation) (step S9). If so, thesetting unit 73 causes the image sensor 100 to capture an image (stepS10). Note that a main image capture refers to an image capture based onan all the way press in step S10. In the present embodiment, theimage-capture unit 20 performs the main image capture in the pixelregion (image-capture region) 113A of the image sensor 100 under theimage-capture conditions of the display region (live view image) lastlyselected by the selection unit 72 in step S5. The control unit 71 thendisplays, in the entire image display region 510, the image (stillimage) obtained by the main image capture in the pixel region(image-capture region) 113A. Thus, the user can check the captured imageusing the large display region.

While the still image acquisition operation has been described withreference to FIGS. 9 to 13, a moving image acquisition operation is alsoperformed in a similar manner. In this case, moving images capturedunder different image-capture conditions (e.g., frame rate) in therespective image-capture regions (first to fourth image-capture regions)are displayed in the respective display regions (first display region511, second display region 512, third display region 513, and fourthdisplay region 514). In this case, a button for setting the frame rateis preferably displayed in the operation button display region 520. Aswith still images, the control unit 71 displays, in the entire imagedisplay region 510, moving images obtained by the main image capture inthe pixel region (image-capture region) 113A.

As described above, the digital camera 1 of the first embodimentincludes: the image-capture unit 20 having multiple first image sensors(some image sensors in the image sensor 100) and multiple second imagesensors (image sensors other than the some image sensors in the imagesensor 100) disposed therein, the first image sensors being configuredto capture an image under first image-capture conditions, the secondimage sensors being configured to capture an image under secondimage-capture conditions different from the first image-captureconditions, the image-capture unit 20 being configured to output firstimage data generated based on a subject image which has entered thefirst image sensors and second image data generated based on a subjectimage which has entered the second image sensors; and the control unit71 configured to display a first image based on the first image data(e.g., an image displayed on the first display region 511) and a secondimage based on the second image data (e.g., an image displayed on thesecond display region 512) on the display unit 50 in such a manner thata selection can be made between respective recording forms of the firstimage data and second image data. According to this embodiment, the usercan check changes in multiple images corresponding to changes made toimage-capture conditions.

Further, in the first embodiment, both the first and second images arelive view images; the digital camera 1 includes the selection unit 72configured to select between the respective recording forms of the firstimage data and second image data; and the image-capture unit 20 performsthe main image capture under image-capture conditions corresponding tothe recording form selected by the selection unit 72. According to thisconfiguration, the user can check multiple live view images capturedunder different image-capture conditions before starting to perform themain image capture for acquiring a still image or moving images.Further, in the first embodiment, the selection unit 72 is provided withthe touchscreen 52 formed on the display unit 50. Thus, the user canselect a live view image with a simple operation.

Further, in the first embodiment, the digital camera 1 includes thedivision unit 74 configured to divide the multiple image sensors of theimage-capture unit 20 into at least the first and second image sensors.According to this configuration, the control unit 71 can display atleast two live view images on the display unit 50. Further, in the firstembodiment, the division unit 74 disposes the multiple first imagesensors and the multiple second image sensors across the pixel region113A of the image-capture unit 20. According to this configuration, theimage-capture unit 20 can capture multiple live view subject imageswhich look like the same subject image for the user. Accordingly, theuser can easily check the differences among the live view subject imagesbased on the differences among the image-capture conditions.

Further, in the first embodiment, the digital camera 1 includes thesetting unit 73 configured to set first and second image-captureconditions. According to this configuration, it is possible to cause theimage sensor 100 to capture images under predetermined image-captureconditions, as well as to capture images under image-capture conditionsselected by the user. Further, in the first embodiment, the setting unit73 makes a change to at least one of the frame rate, gain, and exposuretime serving as image-capture conditions. According to thisconfiguration, before capturing an image, the user can make differencesin frame rate, gain, or exposure time (shutter speed) among the multipleimage-capture regions (multiple live view images) and thus make changesto live view images and then check the changed live view images.

Further, in the first embodiment, the setting unit 73 makes changes toat least one of white balance, gradation, and color tone correctionserving as image-capture conditions. According to this configuration,before capturing an image, the user can make differences in whitebalance, gradation, or color tone correction among the multipleimage-capture regions (multiple live view images) and thus make changesto the live view images and then check the changed live view images.

In the first embodiment, in response to a change being made to one ofthe exposure time (shutter speed) and gain (ISO sensitivity), thesetting unit 73 may make a change to the other of the exposure time andgain so that the first and second images have the same brightness.Specifically, to allow the first and second images to have the samecorrect brightness, the setting unit 73 reduces the gain when increasingthe exposure time of one of the first and second image-capture regions;it increases the gain when reducing the exposure time thereof. Accordingto this configuration, the user can previously check the differencebetween the images based on different combinations of the exposure timeand gain which result in the same brightness.

As shown in FIG. 7, the digital camera 1 has been described as anexample of an electronic apparatus in the first embodiment. However, theelectronic apparatus is not limited to the digital camera 1 and may beany apparatus, including smartphones, mobile phones, and personalcomputers, as long as the apparatus has an image-capture function. Inthe digital camera 1 according to the first embodiment shown in FIG. 7,the display unit 50 may be disposed outside the electronic apparatus. Inthis case, the system control unit 70 and display unit 50 are eachprovided with a communication unit configured to receive or transmitsignals (image data, control signals, or the like) by wire orwirelessly. The image processing unit 30 and system control unit 70 maybe integral with each other. In this case, a system control unitincluding one body-side CPU serves as the image processing unit 30 andsystem control unit 70 when it performs processing on the basis of acontrol program.

Second Embodiment

In the first embodiment, the same image-capture conditions (includingaccumulation conditions) are set across each display region (firstdisplay region 511, second display region 512, third display region 513and fourth display region 514) in the image display region 510. In asecond embodiment, on the other hand, each display region is dividedinto multiple regions, and different image-capture conditions (includingaccumulation conditions) are set for the resulting regions.

FIG. 14 is a diagram showing a display unit 50A of a digital camera 1according to the second embodiment. As shown in FIG. 14, a displaysurface 51A of the display unit 50A has an image display region 510A andan operation button display region 520, as in the display surface 51shown in FIG. 8. The image display region 510A is a region fordisplaying images captured by the image-capture unit 20, that is, stillimages, moving images, or live view images. The operation button displayregion 520 is a region for displaying menus on which the user setsimage-capture conditions or the like.

The image display region 510A is divided into four display regions(first display region 516, second display region 517, third displayregion 518, fourth display region 519). The first display region 516,second display region 517, third display region 518, and fourth displayregion 519 correspond to the first display region 511, second displayregion 512, third display region 513, and fourth display region 514,respectively, shown in FIG. 8. Multiple blocks B(i,j) are set in each ofthe display regions 516, 517, 518, and 519. In an example shown in FIG.14, 8 blocks B(i,j) and 6 blocks B(i,j) where i is 1 to 8 and j is 1 toare set horizontally (in the lateral direction of FIG. 14) andvertically (in the longitudinal direction of FIG. 14), respectively, ineach of the display regions 516, 517, 518, and 519. That is, the displayregions 516, 517, 518, and 519 are each divided into 8×6 (=48) blocks.

A touchscreen 52 is disposed on the display surface 51. Although notshown in FIG. 14, the touchscreen 52 is formed in such a manner that afirst touch region 516 a overlaps the first display region 516; a secondtouch region 517 a overlaps the second display region 517; a third touchregion 518 a overlaps the third display region 518; and a fourth touchregion 519 a overlaps the fourth display region 519, as with thetouchscreen 52 of FIG. 8. When the user presses any of the touch regions516 a, 517 a, 518 a, and 519 a, the touch region detects that it hasbeen pressed (touched) and outputs a detection signal indicating thepressed position (the pressed touch region) to the system control unit70.

The first touch region 516 a is divided into multiple touch regionsP(i,j) corresponding to multiple blocks B(i,j). Similarly, the secondtouch region 517 a, second touch region 518 a, and fourth touch region519 a are each divided into multiple touch regions P(i,j) correspondingto multiple blocks B(i,j). When the user presses any of the touch regionP(i,j), the touch region detects that it has been pressed (touched) andoutputs a detection signal indicating the pressed position (pressedtouch region) to the system control unit 70. In the display surface 51Ashown in FIG. 14, elements similar to those in the display surface 51shown in FIG. 8 are given the same reference signs and will not bedescribed repeatedly.

Next, an imaging operation of the digital camera 1 according to thesecond embodiment will be described. FIG. 15 is a flowchart showing animaging operation performed by the system control unit 70 according tothe second embodiment. FIGS. 16 to 17 are drawings each showing anexample display of the display surface 51A according to the secondembodiment. While the digital camera 1 can acquire both still images andmoving images, a case where it acquires still images will be describedbelow.

Steps S1 to S5 shown in FIG. 15 are similar to steps S1 to S5 shown inFIG. 9 and therefore will not be described repeatedly. After selectingone of the first display region 516, second display region 517, thirddisplay region 518, and fourth display region 519 (see steps S4, S5),the user can select a region in the selected display region.Specifically, the user selects a region in the display region in unitsof blocks by touching any blocks B(i,j) set in the display region with afinger (or sliding a finger on the blocks). The touchscreen 52 thenoutputs, to the system control unit 70, a detection signal correspondingto the touch region P(i,j) touched by the user.

Then, the selection unit 72 identifies the region selected by the useron the basis of the detection signal from the touchscreen 52. In theexample shown in FIG. 16, the first display region 516 is selected bythe user. Further, a region 516A in the first display region 516 isselected by the user. The region 516A is a region behind a waterfall (aregion hatched with white lines in FIG. 16). Specifically, the region516A includes blocks B(3,1), B(4,1), B(5,1), B(6,1), B(7,1), B(8,1),B(4,2), B(5,2), B(6,2), B(7,2), B(8,2), B(5,3), B(6,3), B(7,3), B(8,3),B(6,4), B(7,4), and B(8,4).

The selection unit 72 then determines whether the user has selected anyregion (step S11). If so, the selection unit 72 sets the region 516Aselected by the user (step S12). Specifically, the selection unit 72outputs, to the drive unit 21, a signal indicating the positions or thelike of the blocks selected by the user.

The user can change the image-capture conditions of the selected displayregion (i.e., one of the first to fourth image-capture regions). Theuser also can change the image-capture conditions of the region in theselected display region. The setting unit 72 determines whether the userhas made a change to any image-capture condition (step S14). If so, theselection unit 72 sets the changed image-capture condition (step S15).

For example, if the user wishes to set an ISO sensitivity as animage-capture condition for the region 516A of the first display region516, he or she touches the ISO sensitivity button image 522 (i.e., touchregion 522 a). The touchscreen 52 then outputs, to the system controlunit 70, a detection signal corresponding to the touch region 522 atouched by the user. As shown in FIG. 16, the control unit 71 displaysmultiple ISO sensitivity values on a side of the ISO sensitivity buttonimage 522. At this time, the setting unit 73 sets new touch regions onthe touchscreen 52 in such a manner that the new touch regions overlapthe ISO sensitivity values. The user then touches one of the ISOsensitivity values. The touchscreen 52 then outputs, to the systemcontrol unit 70, a detection signal corresponding to the touch regiontouched by the user. The setting unit 73 then sets the ISO sensitivityvalue touched by the user. Specifically, the setting unit 73 outputs, tothe drive unit 21, a signal indicating a gain corresponding to the ISOsensitivity value selected by the user.

The drive unit 21 receives the signal indicating, in units of blocks,the first image-capture region corresponding to the region 516 selectedby the user. The drive unit 21 also receives the signal indicating, inunits of blocks, the region 516A in the first display region 516selected by the user. The drive unit 21 also receives the signalindicating the image-capture condition selected by the user. The driveunit 21 then drives the image-capture unit 20 in such a manner that theimage-capture unit 20 captures an image under the indicatedimage-capture condition (shutter speed, ISO sensitivity) in the blockscorresponding to the region 516A in the first display region 516. If theimage processing unit 30 receives a signal indicating an image-capturecondition selected by the user, it performs image processing on RAW datafrom a region corresponding to the region 516A under the indicatedimage-capture condition (control parameter such as white balance,gradation, or color tone correction). The lens drive control unit 15adjusts the aperture diameter of the diaphragm 14 on the basis of thecontrol information from the system control unit 70.

As seen above, when a change is made to an image-capture condition ofthe region corresponding to the region 516A in the pixel region 113A, achange is made to an image portion corresponding to the region 516A inthe first live view image. For example, by increasing the ISOsensitivity, a bright image of the subject is captured even with a smallamount of light. Further, dark portions of the region 516A arebrightened. By increasing the shutter speed, blurring of the movingsubject is reduced.

As seen above, the user can select one of the first display region 516,second display region 517, third display region 518, and fourth displayregion 519 and further selects a region in the selected display region.The user then sets an image-capture condition for the selected region.Thus, the user can check a change in the image portion corresponding tothe predetermined region in the live view image corresponding to thechange made to the image-capture condition.

Steps S1 to S5 and S11 to S14 described above are repeated until theuser presses the release switch of the operation unit 55 halfway (stepS8). While the case where the user selects the region 516A of the firstdisplay region 516 in FIG. 16 has been described, a similar process isperformed when the user selects another region in the first displayregion 516. In the example shown in FIG. 17, a region 516B other thanthe region 516A in the image display region 516 is selected. In responseto the user selecting the ISO sensitivity button image 522, shutterspeed button image 523, picture control button image 524, or the like, achange occurs in the image portion displayed in the region 516B in thefirst display region 516.

Subsequently, steps S8 to S10 are performed. These steps are similar tothose described with reference to FIG. 9 and therefore will not bedescribed repeatedly.

While the still image acquisition operation has been described withreference to FIGS. 14 to 17, a moving image acquisition operation isalso performed in the same way. In this case, moving images capturedunder different image-capture conditions (e.g., frame rate) in theimage-capture regions (first to fourth image-capture regions) aredisplayed in the respective display regions (first display region 516,second display region 517, third display region 518, and fourth displayregion 519). At this time, a button for setting the frame rate ispreferably displayed in the operation button display region 520. As withstill images, the control unit 71 displays, in the entire image displayregion 510, moving images obtained by the main image capture in thepixel region (image-capture region) 113A.

In the second embodiment, as described above, the setting unit 73 setsimage-capture conditions for some of the first or second image sensorsin such a manner that the image-capture conditions differ from the firstor second image-capture conditions. According to this configuration, itis possible to produce the effects of the first embodiment, as well asto make changes to image-capture conditions of each region in the firstdisplay region 516, second display region 517, third display region 518,and fourth display region 519. Accordingly, the user can make changes toimage-capture conditions of each region and generate a changed imagebefore acquiring a still image or moving images. Such a process can besaid to be a pre-image-capture edit of an image.

Also in the second embodiment, the image-capture conditions which can beset for each region by the user are not limited to the ISO sensitivity,shutter speed, and picture. For example, the frame rate, thinning-outrate, the number of rows or columns whose pixel signals are summed up,the digitized bit number, and the like may also be set as image-captureconditions for each region. Parameters such as color signal processing,white balance adjustment, gradation adjustment, and compression rate mayalso be set as image-capture conditions for each region.

Third Embodiment

In the first and second embodiments, live view images are displayed inthe four display regions of the single display unit 50. In a thirdembodiment, two live view images or still images are displayed on one oftwo display units, and a live view image obtained by combining the twolive view images or still images is displayed on the other display unit.

FIG. 18 is a function block diagram showing an image processing unit 30Aand a system control unit 70 of a digital camera 1 according to thethird embodiment. Note that FIG. 18 shows only elements corresponding tothe image processing unit 30 and system control unit 70 of the elementsshown in FIG. 7. As shown in FIG. 18, the image processing unit 30Aincludes an image generation unit 31, as well as a combination unit 32.The combination unit 32 combines image data of a first image-captureregion and image data of a second image-capture region captured underdifferent image-capture conditions. In the third embodiment, unlike inthe first and second embodiments (the arrangement pattern shown in FIG.5), only the first and second image-capture regions are set in a pixelregion 113A. In this arrangement pattern, the first image-capture regionincludes blocks in odd rows (2 n−1) in odd columns (2 m−1) and blocks ineven rows (2 n) in even columns (2 m). The second image-capture regionincludes blocks in odd rows (2 n−1) in even columns (2 m) and blocks ineven rows (2 n) in odd columns (2 m−1). That is, a division unit 74divides the pixel region 113A into blocks in such a manner that theblocks are checkered. As used herein, m and n are positive integers(m=1, 2, 3, . . . ; n=1, 2, 3, . . . ).

FIG. 19 is a drawing showing an example of images displayed on a firstdisplay unit 50B and a second display unit 53 according to the thirdembodiment. While only the single display unit 50 is disposed in thefirst and second embodiments, the two display units (first display unit50B and second display unit 53) are disposed in the third embodiment.Note that FIG. 19 shows the appearance of an electronic apparatus(digital camera) 1 seen from the back. As shown in FIG. 19, the firstdisplay unit 50B is a display panel having a rectangular displaysurface. The first display unit 50B is disposed on the back of thedigital camera 1. Although not shown, a first touchscreen is formed onthe display surface of the first display unit 50B.

The second display unit 53 is a display panel having a rectangulardisplay surface. An edge of the second display unit 53 is rotatablycoupled to the first display unit 50B through a hinge (not shown)disposed under the first display unit 50B on the back of the digitalcamera 1. Since the second display unit 53 rotates using the hinge as apivot, the first display unit 50B is opened or closed by the seconddisplay unit 53.

A release switch 55 a, a mode dial 55 b, and a moving image switch 55 care disposed on the upper surface of the digital camera 1. The releaseswitch 55 a is a switch that the user presses to acquire a still image.By pressing the release switch 55 a halfway, functions such as automaticfocusing (AF) or automatic exposure (AE) are prepared. The mode dial 55b is a dial that the user rotates to set a scene mode such as portrait,landscape, or nightscape. The moving image switch 55 c is a switch thatthe user presses to acquire moving images. Disposed on a side of thefirst display unit 50B on the back of the digital camera 1 is amulti-selector 55 d. The multi-selector 55 d includes upper, lower,left, and right arrow keys and OK switch that the user uses to selectamong menus (menus for setting the imaging mode) displayed on the firstdisplay unit 50B or second display unit 53. The release switch 55 a,mode dial 55 b, moving image switch 55 c, and multi-selector 55 d forman operation unit 55. Note that the operation unit 55 may include otherswitches or the like.

As shown in FIG. 19, a control unit 71 displays, in a left region 53L ofthe display surface of the second display unit 53, a live view image orstill image (an image of a person captured at night) captured in thefirst image-capture region. The control unit 71 also displays, in aright region 53R of the display surface of the second display unit 53, alive view image or still image captured in the second image-captureregion. The control unit 71 also displays, in a central region 51G ofthe first display unit 51, a live view image or still image obtained bycombining the live view image or still image captured in the firstimage-capture region and the live view image or still image captured inthe second image-capture region.

High dynamic range (HDR) imaging is widely known as an image combiningtechnology for recording and displaying a wide-dynamic-range image. InHDR imaging, an image having less blown-out highlights or blocked-upshadows is generated by capturing multiple images while changingimage-capture conditions (e.g., exposure) and then combining themultiple images. However, in traditional HDR, multiple images (e.g., twoimages) are captured under different image-capture conditions atdifferent image-capture times and therefore the subject may move or theuser (photographer) may move the digital camera 1. In this case, themultiple images are not images of the same subject and therefore aredifficult to combine. In the third embodiment, on the other hand, twoimages (live view images or still images) can be captured underdifferent image-capture conditions at the same (or approximately thesame) image-capture time. This configuration according to the thirdembodiment can solve the problem with the traditional HDR imaging. Notethat HDR mode is allowed to be selected, for example, in response to anoperation of the multi-selector 55 d by the user.

According to the above configuration, before capturing an image, theuser can check the first live view image or still image captured in thefirst image-capture region and the second live view image or still imagecaptured in the second image-capture region under differentimage-capture conditions. Further, before capturing an image, the usercan check a wide-dynamic-range live view image or still image obtainedby combining the first live view image or still image and the secondlive view image or still image.

In the third embodiment, the combination unit 32 generateswide-dynamic-range image data by combining image data captured in thefirst image-capture region and image data captured in the secondimage-capture region. However, other configurations may be employed. Forexample, the combination unit 32 may generate image data where the edgeof the subject is enhanced, by combining image data captured in thefirst image-capture region and image data captured in the secondimage-capture region. Specifically, the setting unit 73 sets the shutterspeed of the first image-capture region to 1/30 s and sets the shutterspeed of the second image-capture region to 1/200 s. Thus, if the imagesensor 100 captures an image of a fast-moving subject, image data wherethe subject is significantly blurred is generated in the firstimage-capture region of the image sensor 100. On the other hand, imagedata where the subject is blurred to a lesser extent is generated in thesecond image-capture region. The combination unit 32 then combines, withthe data generated in the first image-capture region, data correspondingto the edge of the subject in the data generated in the secondimage-capture region. Thus, image data where the edge of the movingsubject is enhanced can be obtained.

The control unit 71 displays a live view image or still image from thefirst image-capture region in the left region 53L of the display surfaceof the second display unit 53. The control unit 71 also displays a liveview image or still image from the second image-capture region in theright region 53R of the display surface of the second display unit 53.The control unit 71 also displays, in a central region 51G of the firstdisplay unit 51, a live view image or still image obtained by combiningthe live view image or still image from the first image-capture regionand the live view image or still image from the second image-captureregion (a combined image where the edge of the subject is enhanced).According to this configuration, the user can check images captured atdifferent shutter speeds, as well as an image obtained by combining suchimages.

Fourth Embodiment

In the first to third embodiments, the control unit 71 displays thefirst to fourth live view images in the first display region 511, seconddisplay region 512, third display region 513, and fourth display region514, respectively, (or first display region 516, second display region517, third display region 518, and fourth display region 519,respectively). In a fourth embodiment, on the other hand, a control unit71 displays first to fourth moving images in the first to fourth displayregions, respectively. A display unit displays the first to fourthmoving images at respective refresh rates (the number of times refreshis performed per unit time) corresponding to the respective frame rates.

FIG. 20 is a drawing showing an example display of a display surface 51Caccording to the fourth embodiment. As shown in FIG. 20, a frame ratebutton image 545 for setting the frame rate is displayed in an operationbutton display region 540. The frame rate button image 545 is alsoincluded in a menu image 540M. A selection button image 541, an ISOsensitivity button image 542, a shutter speed button image 543, and apicture control button image 544 correspond to the selection buttonimage 521, ISO sensitivity button image 522, shutter speed button image523, and picture control button image 524, respectively, shown in FIG. 8and the like. In the example display shown in FIG. 20, the frame ratebutton image 545 is disposed in place of the imaging mode button image525 shown in FIG. 8 and the like. In the example shown in FIG. 20, thefirst display region 531, second display region 532, third displayregion 533, and fourth display region 534 correspond to the firstdisplay region 511, second display region 512, third display region 513,and fourth display region 514, respectively, shown in FIG. 8 and thelike.

A setting unit 73 sets different frame rates for the first to fourthimage-capture regions of the image sensor 100 in response to anoperation of the frame rate button image 545 by the user, orautomatically. For example, the setting unit 73 sets the frame rate ofthe first image-capture region to 30 fps, the frame rate of the secondimage-capture region to 60 fps, the frame rate of the thirdimage-capture region to 90 fps, and the frame rate of the fourthimage-capture region to 120 fps. Then, in response to an operation ofthe moving image switch by the user, the setting unit 73 causes theimage sensor 100 to capture moving images at different frame rates inthe first to fourth image-capture regions of the image sensor 100.

The control unit 71 then displays the moving images captured at thedifferent frame rates in the first to fourth image-capture regions inthe first display region 531, second display region 532, third displayregion 533, and fourth display region 534 of the image display region530. Typically, a display unit including a liquid crystal displayrefreshes (updates) the image at the same refresh rate across thedisplay surface. The display unit 50C according to the fourthembodiment, on the other hand, can refresh the image at differentrefresh rates in the first display region 531, second display region532, third display region 533, and fourth display region 534 of thedisplay surface 51C. Specifically, a drive circuit for driving therefresh of the pixels in the first display region 531, a drive circuitfor driving the refresh of the pixels of the second display region 532,a drive circuit for driving the refresh of the pixels of the thirddisplay region 533, and a drive circuit for driving the refresh of thepixels of the fourth display region 534 are separately disposed on thedisplay surface 51C of the display unit 50C. According to thisconfiguration, the user can easily recognize the differences among themultiple sets of moving images captured at different refresh rates.

Further, the control unit 71 separately records, in the recording unit60, respective sets of image data of the first to fourth moving imagescaptured at the different frame rates in the first to fourthimage-capture regions of the image sensor 100. According to thisconfiguration, the respective sets of image data of the multiple sets ofmoving images captured at the different refresh rates can besimultaneously recorded in the recording unit 60.

In the first to third embodiments, the control unit 71 displays, in thefirst to fourth display regions of the display surface, live view imagesor moving images captured under different image-capture conditions(shutter speed, frame rate, or the like). However, it may display, inthe first to fourth display regions of the display surface, still imagescaptured under different image-capture conditions. In this case, thecontrol unit 71 displays first to fourth still images captured based ona single operation of the release switch by the user, in the first tofourth display regions, respectively. According to this configuration,the user can easily recognize the differences among the multiple stillimages captured at the different image-capture conditions.

Fifth Embodiment

In a fifth embodiment, when the user zooms in an image using anelectronic zoom (also called a digital zoom) in one of the first tofourth display regions, a system control unit 70 zooms in images in theother display regions in accordance with the zoom-in of the image.

If the user wishes to zoom in an image using an electronic zoom, he orshe, for example, touches the touchscreen on the display surface. Inresponse, the control unit 71 outputs, to an image processing unit 30, asignal indicating a region to be cut out from the image. The imageprocessing unit 30 then cuts off (trims) image data of the regionindicated by the system control unit 70. The control unit 71 thenoutputs the image data of the region cut out by the image processingunit 30 to the display unit to cause the display unit to zoom in animage based on the image data of the region on the display surface ofthe display unit.

FIG. 21 is a drawing showing an example display of a display surface 51Dwhen an electronic zoom is performed according to the fifth embodiment.In the example display of the display unit 50D shown in FIG. 21, a firstdisplay region 511D, a second display region 512D, a third displayregion 513D, and a fourth display region 514D correspond to the firstdisplay region 511, second display region 512, third display region 513,and fourth display region 514, respectively, shown in FIG. 8 and thelike. An operation button display region 520 is similar to those shownin FIG. 8 and like and therefore will not be described repeatedly.

For example, as shown in FIG. 21, the user selects a region 516D in thefirst display region 511D by touching a touchscreen formed on the firstdisplay region 511D, in order to zoom in a portrait image O1 displayedin the region 516D using an electronic zoom. In response to such anoperation, the control unit 71 zooms in the portrait image O1 displayedin the region 516D of the first display region 511D across the firstdisplay region 511D. The control unit 71 also zooms in portrait imagesO1 in the second display region 512D, third display region 513D, andfourth display region 514D at the same display magnification as that atwhich the portrait image O1 in the first display region 511D has beenzoomed in. Specifically, the control unit 71 zooms in, across the seconddisplay region 512D, a portrait image O1 displayed in a region 517D ofthe second display region 512D. The control unit 71 also zooms in,across the third display region 513D, a portrait image O1 displayed in aregion 518D of the third display region 513D. The control unit 71 alsozooms in, across the fourth display region 514D, a portrait image O1displayed in a region 519D of the fourth display region 514D.

Further, when the user zooms out an image using the electronic zoom inone of the first display region 511D, second display region 512D, thirddisplay region 513D, and fourth display region 514D, the control unit 71can zoom out images in the other display regions in accordance with thezoom-out of the image. For example, as shown in FIG. 21, the userselects the entire first display region 511D by touching the touchscreenformed thereon, in order to zoom out a portrait image O1 displayedacross the first display region 511D using the electronic zoom. Inresponse to such an operation, the control unit 71 zooms out, in theregion 516D of the first display region 511D, the portrait image O1displayed across the first display region 511D. The control unit 71 alsozooms out portrait images O1 in the second display region 512D, thirddisplay region 513D, and fourth display region 514D at the same displaymagnification as that at which the portrait image O1 in the firstdisplay region 511D has been zoomed out.

As described above, when the user zooms in or out one of a first image(e.g., the portrait image O1 displayed in the first display region 511D)and a second image (e.g., the portrait image O1 displayed in the seconddisplay region 512D), the control unit 71 of the fifth embodiment zoomsin or out the other image in accordance with the zoom-in or zoom-out ofthe one image. According to this configuration, when the user zooms inor out an image using the electronic zoom, he or she can equalize thesizes of the images displayed in the respective display regions and thuseasily recognize the differences among the images resulting from thedifferences among the image-capture conditions. Further, the user doesnot need to zoom in or out the respective images, that is, the operationof the user does not increase.

The fifth embodiment is applicable to the case where the user performsthe electronic zoom by touching the touchscreen, as well as to a casewhere the user performs the electronic zoom by operating, for example,an electronic zoom switch (i.e., a switch operated to perform theelectronic zoom) of the operation unit 55.

Sixth Embodiment

FIG. 22 is a drawing showing an example display of a display surface 51Eaccording to a sixth embodiment. In the example display of the displayunit 50E shown in FIG. 22, a first display region 511E, a second displayregion 512E, a third display region 513E, and a fourth display region514E correspond to the first display region 511, second display region512, third display region 513, and fourth display region 514,respectively, shown in FIG. 8 and the like. An operation button displayregion 520 is similar to those shown in FIG. 8 and like and thereforewill not be described repeatedly.

As shown in FIG. 22, a control unit 71 displays first to fourth imagesand the image-capture conditions thereof in the first display region511E, second display region 512E, third display region 513E, and fourthdisplay region 514E, respectively, in such a manner that the respectiveimage-capture conditions are overlaid on the first to fourth images. Inthe example shown in FIG. 22, the image-capture conditions of the firstimage are set as follows:

ISO sensitivity=“100”; shutter speed=“½ s”; picture control=“standard”;and imaging mode=“P.” The image-capture conditions of the second imageare set as follows: ISO sensitivity=“200”; shutter speed=“ 1/100 s”;picture control=“standard”; and imaging mode=“P.” The image-captureconditions of the third image are set as follows: ISO sensitivity=“400”;shutter speed=“ 1/500 s”; picture control=“standard”; and imagingmode=“P.” The image-capture conditions of the fourth image are set asfollows: ISO sensitivity=“800”; shutter speed=“ 1/1000 s”; picturecontrol=“standard”; and imaging mode=“P.” According to thisconfiguration, the user can easily check the image-capture conditionscurrently set in each display region.

As an alternative, an image-capture condition display region fordisplaying the image-capture conditions currently set in the displayregion (e.g., first display region) selected by the user may be disposedon a lower portion of the display surface of the display unit. Asanother alternative, the control unit 71 may display the image-captureconditions only for a predetermined time. An yet another alternative,the following configuration may be used: a switch for making a selectionas to whether to display the image-capture conditions (a switch in theoperation unit 55 or a switch on the touchscreen) is provided; and thecontrol unit 71 switches between display and non-display of theimage-capture conditions in an image-capture conditions display region550 in response to an operation of this switch.

Seventh Embodiment

In the operation button display region 520 shown in FIG. 10 and thelike, the buttons 521, 522, 523, 524, and 525 are arranged in apredetermined order. That is, the selection button image 521 is placedin the highest position; the ISO sensitivity button image 522 in thesecond highest position (i.e., under the selection button image 521);the shutter speed button image 523 in the third highest position (i.e.,under the ISO sensitivity button image 522); the picture control buttonimage 524 in the fourth highest position (i.e., under the shutter speedbutton image 523); and the imaging mode button image 525 in the lowestposition. In a seventh embodiment, on the other hand, a control unit 71changes the arrangement of the displayed buttons 521 to 525 inaccordance with the subject in the display region. Further, in theseventh embodiment, the control unit 71 displays a button having higherpriority with a different appearance from that of the other buttons.

FIG. 23 is a drawing showing an example display of a display surface 51Faccording to the seventh embodiment. In the example display of thedisplay unit 50F shown in FIG. 23, a selection button image 521 isplaced in the highest position; a shutter speed button image 523 in thesecond highest position (i.e., under the selection button image 521); apicture control button image 524 in the third highest position (i.e.,under the shutter speed button image 523); an ISO sensitivity buttonimage 522 in the fourth highest position (i.e., under the picturecontrol button image 524); and an imaging mode button image 525 in thelowest position. As shown in FIG. 23, the shutter speed button image 523is larger than the other buttons (selection button image 521, ISOsensitivity button image 522, picture control button image 524, imagingmode button image 525).

A touchscreen 52 is formed in such a manner that a touch region 521 aoverlaps the selection button image 521; a touch region 523 a overlapsthe shutter speed button image 523; a touch region 524 a overlaps thepicture control button image 524; a touch region 522 a overlaps the ISOsensitivity button image 522; and a touch region 525 a overlaps theimaging mode button image 525. The touch region 523 a, whose sizematches that of the shutter speed button image 523, is larger than theother buttons.

Next, a process of changing the arrangement of the buttons 521 to 525performed by an image processing unit 30 and a system control unit 70will be described. When the user makes changes to image-captureconditions, the system control unit 70 instructs the image processingunit 30 to detect a moving subject. The image processing unit 30 thendetects a moving subject and a non-moving subject by making comparisonamong multiple sets of image data chronologically obtained from liveview images. The image processing unit 30 then outputs the detectionresult along with the image data to the system control unit 70.

The control unit 71 determines whether any moving subject is included ina display region selected by a selection unit 72, on the basis of thedetection result from the image processing unit 30. If so, the controlunit 71 displays the shutter speed button image 523, which is a buttonfor setting the shutter speed, in the second highest position, as shownin FIG. 23. At this time, the control unit 71 displays the shutter speedbutton image 523 in such a manner that the shutter speed button image islarger than the other buttons.

When the shutter speed is changed, the way the moving subject isdisplayed is changed. For example, assuming that the moving subject is awaterfall, when the shutter speed is increased, the image appears as ifthe flow of the waterfall stopped momentarily. In contrast, when theshutter speed is reduced, the image appears as if the flow of thewaterfall were a thread. As seen above, for a moving subject, theshutter speed more significantly influences the way the moving subjectis displayed than the other image-capture conditions. Accordingly, whena moving subject is included in the region, the control unit 71determines that the shutter speed has higher priority than the otherimage-capture conditions. The control unit 71 then moves the position ofthe shutter speed button image 523 upward, as well as displays theshutter speed button image 523 as a larger button. Thus, the buttonhaving higher priority is placed in a position in which the user caneasily operate the button, thereby increasing the usability. Further,the button (i.e., image-capture condition) having higher prioritybecomes more conspicuous than the other buttons (i.e., image-captureconditions). Thus, the user can be urged to operate the button havinghigher priority.

In the example described above, the control unit 71 changes thearrangement and appearance (size) of the buttons on the basis of whethera subject in a region is a moving subject. However, other configurationsmay be employed. For example, the system control unit 70 instructs theimage processing unit 30 to detect the brightness of the image portionin the region. The image processing unit 30 then detects the brightnessof the image portion in the region on the basis of a corresponding liveview image portion. The image processing unit 30 then outputs thedetection result along with the image data to the system control unit70.

The control unit 71 then determines whether the brightness of the imageportion in the region selected by the selection unit 72 falls within apredetermined range, on the basis of the detection result from the imageprocessing unit 30. If not so, the control unit 71 displays the ISOsensitivity button image 522, which is a button for setting the ISOsensitivity, in the second highest place. At this time, the control unit71 displays the ISO sensitivity button image 522 in such a manner thatthe ISO sensitivity button is larger than the other buttons.

By changing the ISO sensitivity, the dark part of the live view image isbrightened, and the bright part thereof is darkened. If the brightnessin the region does not fall within the predetermined range, that is, ifthe image portion in the region is too bright or too dark, it ispossible to bring the exposure close to the optimum exposure by changingthe ISO sensitivity. Accordingly, if the brightness of the image portionin the region does not fall within the predetermined range, the controlunit 71 determines that the ISO sensitivity has higher priority than theother image-capture conditions. The control unit then moves the positionof the ISO sensitivity button image 522 upward, as well as displays theISO sensitivity button image 522 as a larger button. Thus, the buttonhaving higher priority is placed in a position in which the user caneasily operate the button, thereby increasing the usability. Further,the button (i.e., image-capture condition) having higher prioritybecomes more conspicuous than the other buttons (i.e., image-captureconditions). Thus, the user can be urged to operate the button havinghigher priority.

Methods for displaying a button having higher priority conspicuouslyinclude the enlargement of the button, as well as change of the buttoncolor and blinking of the button. A button having higher priority may bemade conspicuous by displaying multiple image-capture condition valueson a side of the button before the user presses the button. Only thearrangement of the buttons may be changed, or only the appearance of thebuttons may be changed.

The arrangement and appearance of the buttons may also be changedaccording to the order in which the user operates the buttons. Forexample, assume that the user presses the selection button image 521,then selects a display region, then presses the imaging mode buttonimage 525, selects manual mode as the imaging mode, and then makeschanges to image-capture conditions of each display region. In thiscase, the control unit 71 places the selection button image 521 in thehighest position, as well as enlarges it. The control unit 71 thenplaces the imaging mode button image 525 in the highest position, aswell as enlarges it. Then, the control unit 71 places one of the ISOsensitivity button image 522, shutter speed button image 523, andpicture control button image 524 in the highest place and enlarges it inaccordance with the subject (image) in each display region. By changingthe arrangement and appearance of the buttons in accordance with theorder in which the user operates the buttons, as described above, userconvenience is improved.

Eighth Embodiment

Generally, causing the strobe to emit light at the same time that theshutter curtain fully opens is called first curtain synchronization. Onthe other hand, causing the strobe to emit light immediately before theshutter curtain starts to close is called second curtainsynchronization. In the eighth embodiment, a setting unit 73 sets a slowshutter speed (e.g., ½ s) for the first and second image-captureregions. The system control unit also causes the strobe 90 to emit lightimmediately before charge accumulation ends in the first image-captureregion. That is, images are captured in the first image-capture regionusing second curtain synchronization. The system control unit 70 alsocauses the strobe 90 to emit light at the same time that chargeaccumulation starts in the second image-capture region. That is, imagesare captured in the second image-capture region using first curtainsynchronization.

FIG. 24 is a timing chart showing the timing of light emission of thestrobe 90 and the timing of charge accumulation according to the eighthembodiment. As shown in FIG. 24, the setting unit 73 accumulates chargein the first image-capture region over a period from timing t1,preceding timing t2 when the strobe 90 starts to emit light, to timingt3 when the amount of light emitted by the strobe 90 is lost. Thesetting unit 73 also accumulates charge in the second image-captureregion over a period from timing t2 when the strobe 90 starts to emitlight to timing t4, following the timing t3 when the amount of lightemitted by the strobe 90 is lost. The control unit 71 then displays, inthe first display region 511, a first image based on image datagenerated in the first image-capture region and displays, in the seconddisplay region 512, a second image based on image data generated in thesecond image-capture region.

Thus, the user can previously check the difference between the firstimage captured using second curtain synchronization and the second imagecaptured using first curtain synchronization. When first curtainsynchronization is used, for example, the afterimage and light trace ofan automobile and the light thereof, which are the subjects, are left infront of the automobile. Thus, there is obtained an image as if theautomobile were moving backward though it were moving forward. On theother hand, when second curtain synchronization is used, there isobtained an image where the afterimage and light trace of an automobileand the light thereof appear behind the automobile naturally.

Ninth Embodiment

A ninth embodiment provides a configuration where the digital camera 1according to the first embodiment is divided into an image-capturedevice 1A and an electronic apparatus 1B.

FIG. 25 is a block diagram showing the configuration of theimage-capture device 1A and electronic apparatus 1B according to theninth embodiment. In the configuration shown in FIG. 25, the imagingdevice 1A captures images of subjects. The imaging device 1A includes alens unit 10, an image-capture unit 20, an image processing unit 30, awork memory 40, an operation unit 55, a recording unit 60, and a firstsystem control unit 70A. The lens unit 10, image-capture unit 20, imageprocessing unit 30, work memory 40, operation unit 55, and recordingunit 60 in the imaging device 1A are similar to those shown in FIG. 7and therefore will not be described repeatedly.

The electronic apparatus 1B displays images (still images, movingimages, live view images). The electronic apparatus 1B includes adisplay unit 50 and a second system control unit (control unit) 70B. Thedisplay unit 50 of the electronic apparatus 1B is similar to that shownin FIG. 7 and therefore will not be described repeatedly.

The first system control unit 70A includes a first communication unit75A. The second system control unit 70B includes a second communicationunit 75B. The first communication unit 75A and second communication unit75B transmit or receive signals to or from each other by wire orwirelessly. In this configuration, the first system control unit 70Atransmits image data (image data processed by the image processing unit30, image data recorded in the recording unit 60) to the secondcommunication unit 75B through the first communication unit 75A. Thesecond system control unit 70B causes the display unit 50 to display theimage data received by the second communication unit 75B. The systemcontrol unit 70B also causes a second display unit 53 to display apreset menu image.

The system control unit 70B also make changes to image-captureconditions (including accumulation conditions) in response to a touch ona touchscreen 52 by the user, or automatically. The system control unit70B also selects a display region in an image display region 510 inresponse to a touch on the touchscreen 52 by the user, or automatically.The first system control unit 70A controls image capture in response toan operation of the operation unit 55 (an operation unit disposed on theelectronic apparatus 1B and configured to request the start ofacquisition of still images or moving images) by the user.

The elements shown in FIG. 7 (control unit 71, selection unit 72,setting unit 73, and division unit 74) may be disposed in any of thefirst system control unit 70A and second system control unit 70B. Allthe elements shown in FIG. 7 may be disposed in one of the first systemcontrol unit 70A and second system control unit 70B. Some of theelements shown in FIG. 7 may be disposed in the first system controlunit 70A, and the other elements may be disposed in the system controlunit 70B.

Examples of the image-capture device 1A include digital cameras,smartphones, mobile phones, and personal computers which each haveimage-capture and communication functions. Examples of the electronicapparatus 1B include smartphones, mobile phones, and portable personalcomputers which each have a communication function.

The first system control unit 70A shown in FIG. 25 is implemented when abody-side CPU performs processing on the basis of a control program. Thesecond system control unit 70B shown in FIG. 25 is also implemented whenthe body-side CPU performs processing on the basis of the controlprogram.

As seen above, the ninth embodiment produces the effects described inthe first embodiment, as well as allows the user to check multiple liveview images being captured by the image-capture device 1A using a mobileterminal such as a smartphone before capture an image.

In the configuration shown in FIG. 25, the image processing unit 30 andfirst system control unit 70A may be integral with each other. In thiscase, a system control unit including one body-side CPU serves as theimage processing unit 30 and first system control unit 70A when itperforms processing on the basis of a control program.

While the present invention has been described using the embodiments,the technical scope of the invention is not limited to the scopedescribed in the embodiments. Various changes or modifications can bemade to the embodiments without departing from the spirit and scope ofthe invention. One or more of the elements described in the embodimentsmay be omitted. Forms resulting from such changes, modifications, oromission are also included in the technical scope of the invention.Elements of the embodiments or modifications may be combined asappropriate and used.

For example, while the color filters 102 form Bayer arrays in theembodiments, they may form other types of arrays. Each unit group 131only has to include at least one pixel. Each block only has to includeat least one pixel. Thus, it is also possible to capture an image underimage-capture conditions which vary among the pixels.

In the embodiments, part or all of the drive unit 21 may be included inthe image-capture chip 113 or signal processing chip 111. Part of theimage processing unit 30 may be included in the image-capture chip 113or signal processing chip 111. Part of the system control unit 70 may beincluded in the image-capture chip 113 or signal processing chip 111.

Further, while the user selects a display region and then makes changesto image-capture conditions (including accumulation conditions) thereofin the embodiments, the user may first makes changes to image-captureconditions and then select a display region in which the changedimage-capture conditions are reflected. In the first and secondembodiments, the control unit 71 may delete, from the display panel 51,a display region (live view image) selected by the user of the fourdisplay regions in the display panel 51. According to thisconfiguration, the user can delete a live view image captured underimage-capture conditions under which the user does not wish to capturean image and thus can easily make comparison among live view imagesdesired by the user. If the control unit 71 deletes a display region(live view image) selected by the user from the display panel 51, it maydisplay a live view image generated by the combination unit 32 in thespace corresponding to the deleted display region.

In the embodiments, in response to one full press, the image-captureunit 20 captures an image in the entire pixel region 113A (all pixels)under the image-capture conditions of the display region selected by theuser. However, other configurations may be employed. For example, inresponse to one full press, the image-capture unit 20 may capture animage in one divided region (e.g., first image-capture region) of thepixel region 113A under the image-capture conditions of the displayregion selected by the user. There may be also employed a configurationwhere the user can select two or more display regions. In this case, inresponse to one full press, the image-capture unit 20 may simultaneouslycapture images in two or more divided regions (e.g., first and secondimage-capture regions) of the pixel region 113A under the respectiveimage-capture conditions of two or more display regions selected by theuser.

As shown in FIG. 5, the image-capture regions in the pixel region 113Aeach include different multiple blocks. Accordingly, the imagegeneration unit 31 may generate one live view image with respect to allthe pixels in the pixel region 113A by stacking live view imagescaptured in the respective image-capture regions. At this time, thecontrol unit 71 may display such a live view image generated by theimage generation unit 31 on the display panel 51 (image display region510). While the display regions 511, 512, 513, and 514 (or displayregions 516, 517, 518, and 519) in the image display region 510 have thesame area, the display regions may have different areas.

While the operation button display region 520 is located near the imagedisplay region 510 in the embodiments, it may be located in a positionwhich is not near the image display region 510. The operation buttondisplay region 520 may also be located in a position which issuperimposed on the image display region 510. The user may operate theoperation unit 55 rather than touching the touchscreen 52.

In the embodiments, it is assumed that the image-capture conditions of alive view image selected by the user are the same as the image-captureconditions of an image acquired in response to a full press of therelease switch or the like. This is intended to ensure that an image tobe actually acquired can be checked using a live view image. However,the image-capture conditions of a live view image may be different fromthose of an image to be actually acquired. In this case, changes aremade to the image-capture conditions to the extent that the user canrecognize an image to be actually generated using a live view images.

In the embodiments, the division unit 74, as shown in FIG. 5, dividesthe image-capture region 113A of the image sensor 100 into the first tofourth image-capture regions. However, the division unit 74 may dividethe image-capture region 113A into two regions, first and secondimage-capture regions, into three regions, first to third image-captureregions, or into five or more image-capture regions. In this case,display regions in a number corresponding to the number of image-captureregions divided by the division unit 74 are disposed in the imagedisplay region of the display unit. For example, if the division unit 74divides the image-capture region 113A into two image-capture regions,two display regions (first and second display regions) are disposed inthe image display region; if it divides the image-capture region 113Ainto five or more image-capture regions, five or more display regionsare disposed in the image display region.

While the sizes (areas) of the first to fourth display regions in theimage display region are fixed in the above embodiments, the sizes ofthe first to fourth display regions in the image display region may bevariable in the fifth embodiment. For example, the user takes the firstdisplay region between finders and then moves the finders away from eachother (pinch-out operation). In response to such an operation, thecontrol unit 71 zooms in the first display region. The control unit 71then automatically zooms out the second to fourth display regions inaccordance with the zoom-in of the first display region. According tothis configuration, the user can zoom in a display region (a displayregion displaying an image of interest) that the user wishes to see mosteagerly.

In contrast, the user takes, for example, the first display regionbetween fingers and then bring them into close to each other (pinch-inoperation). In response to such an operation, the control unit 71 zoomsout the first display region. The control unit 71 then automaticallyzooms in the second to fourth display regions in accordance with thezoom-out of the first display region. According to this configuration,the user can zoom out a display region displaying an image which theuser does not note.

While the control unit 71 zooms in or out a display region in responseto an operation of the user in the above embodiments, it mayautomatically zoom in a display region displaying an image capturedunder recommended image-capture conditions and automatically zoom outthe other display regions in accordance with the size of the zoomed-indisplay region.

The display units 50, 50A, 50B, 50C, 50D, 50E, and 50F do not need toinclude a liquid crystal display, which controls display of the pixelsby controlling transmission of backlight by applying a voltage and mayinclude an organic electroluminescent liquid crystal display, whichcontrols display of the pixels by controlling spontaneous light emissionby applying a voltage.

DESCRIPTION OF REFERENCE SIGNS

1, 1B: digital camera, 1A: image-capture device, 20: image-capture unit,30, 30A: image processing unit, 31: image generation unit 31, 32:combination unit, 50, 50A, 50C, 50D, 50E, 50F: display unit, 50B: firstdisplay unit, 51, 51A, 51C, 51D, 51E, 51F: display surface, 52(selection unit): touchscreen, 53: second display unit, 70: systemcontrol unit, 70A: first system control unit, 70B: second system controlunit, 71: control unit, 72: selection unit, 72: setting unit, 73:setting unit, 74: division unit, 100: image sensor

What is claimed:
 1. An electronic apparatus comprising: an image sensorincluding a plurality of pixels, each pixel including one of a pluralityof photoelectric converters that convert light into charge; a displaythat displays (i) a first image based on the charge accumulated during afirst accumulation time in a first photoelectric converter, of theplurality of photoelectric converters, included in at least a firstpixel of the plurality of pixels, and (ii) a second image based on thecharge accumulated during a second accumulation time longer than thefirst accumulation time in a second photoelectric converter, of theplurality of photoelectric converters, included in at least a secondpixel of the plurality of pixels; and a controller that controls acharge accumulation time in the plurality of photoelectric convertersincluded in the plurality of pixels based on an image selected fromamong the first image and the second image, wherein the image sensorincludes a pixel region in which the plurality of pixels is arrangedside by side in a row direction and a column direction, and the secondpixel is arranged at a position along the row direction with respect tothe first pixel in the pixel region.
 2. The electronic apparatusaccording to claim 1, wherein the image sensor includes: a first controlline that is connected to the first pixel and receives a control signalfor controlling the first accumulation time in the first photoelectricconverter; and a second control line that is connected to the secondpixel and receives a control signal for controlling the secondaccumulation time in the second photoelectric converter.
 3. Theelectronic apparatus according to claim 2, wherein the first pixelincludes a first transferer for transferring the charge accumulated inthe first photoelectric converter, and the second pixel includes asecond transferer for transferring the charge accumulated in the secondphotoelectric converter.
 4. The electronic apparatus according to claim3, wherein the image sensor includes: a third control line that isconnected to the first pixel and receives a control signal forcontrolling the first accumulation time in the first photoelectricconverter; and a fourth control line that is connected to the secondpixel and receives a control signal for controlling the secondaccumulation time in the second photoelectric converter, the first pixelincludes a first resetter that is connected to the third control lineand discharges the charge accumulated in the first photoelectricconverter, and the second pixel includes a second resetter that isconnected to the fourth control line and discharges the chargeaccumulated in the second photoelectric converter.
 5. The electronicapparatus according to claim 2, wherein the first pixel includes a firstresetter that is connected to the first control line and discharges thecharge accumulated in the first photoelectric converter, and the secondpixel includes a second resetter that is connected to the second controlline and discharges the charge accumulated in the second photoelectricconverter.
 6. The electronic apparatus according to claim 1, wherein theimage sensor further includes: a first converter that converts a firstsignal based on the charge accumulated in the first photoelectricconverter into a digital signal; and a second converter that converts asecond signal based on the charge accumulated in the secondphotoelectric converter into a digital signal, the first image isgenerated based on the first signal converted into the digital signal bythe first converter, and the second image is generated based on thesecond signal converted into the digital signal by the second converter.7. The electronic apparatus according to claim 6, wherein the imagesensor further includes: a first chip in which the first photoelectricconverter and the second photoelectric converter are arranged; and asecond chip in which the first converter and the second converter arearranged.
 8. The electronic apparatus according to claim 7, wherein thefirst chip has a first surface on which light from an optical system isincident and a second surface opposite to the first surface, and thesecond chip is arranged on a side of the second surface of the firstchip.
 9. The electronic apparatus according to claim 1, wherein theimage sensor further includes: a first converter that converts a firstsignal based on the charge accumulated in the first photoelectricconverter into a first digital signal; a second converter that convertsa second signal based on the charge accumulated in the secondphotoelectric converter into a second digital signal; a first recorderthat records the first digital signal converted by the first converter;and a second recorder that records the second digital signal convertedby the second converter, the first image is generated based on the firstdigital signal recorded by the first recorder, and the second image isgenerated based on the second digital signal recorded by the secondconverter.
 10. The electronic apparatus according to claim 9, whereinthe image sensor further includes: a first chip in which at least thefirst photoelectric converter and the second photoelectric converter arearranged; a second chip in which at least the first converter and thesecond converter are arranged; and a third chip in which at least thefirst recorder and the second recorder are arranged.
 11. The electronicapparatus according to claim 10, wherein the first chip has a firstsurface on which light from an optical system is incident and a secondsurface opposite to the first surface, and the third chip is arranged ona side of the second surface of the first chip.
 12. The electronicapparatus according to claim 11, wherein the second chip is arrangedbetween the first chip and the third chip in an optical axis directionof the optical system.